Modeling input modality choice in mobile graphical and speech interfaces

In this paper, we review three experiments with a mobile application that integrates graphical input with a touch-screen and a speech interface and develop a model for input modality choice in multimodal interaction. The model aims to enable simulation of multimodal human-computer interaction for automatic usability evaluation. The experimental results indicate that modality efficiency and input performance are important moderators of modality...