Mobile and Multimodal? A Comparative Evaluation of Interactive Workplaces for Visual Data Exploration
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Mobile devices are increasingly being used in the workplace. The combination of touch, pen, and speech interaction with mobile devices is considered particularly promising for a more natural experience. However, we do not yet know how everyday work with multimodal data visualizations on a mobile device differs from working in the standard WIMP workplace setup. To address this gap, we created a visualization system for social scientists, with a WIMP interface for desktop PCs, and a multimodal interface for tablets. The system provides visualizations to explore spatio-temporal data with consistent WIMP and multimodal interaction techniques. To investigate how the different combinations of devices and interaction modalities affect the performance and experience of domain experts in a work setting, we conducted an experiment with 16 social scientists where they carried out a series of tasks with both interfaces. Participants were significantly faster and slightly more accurate on the WIMP interface. They solved the tasks with different strategies according to the interaction modalities available. The pen was the most used and appreciated input modality. Most participants preferred the multimodal setup and could imagine using it at work. We present our findings, together with their implications for the interaction design of data visualizations.
Description
CCS Concepts: Human-centered computing --> Empirical studies in visualization; Interaction design; Applied computing --> Law, social and behavioral sciences
@article{10.1111:cgf.14551,
journal = {Computer Graphics Forum},
title = {{Mobile and Multimodal? A Comparative Evaluation of Interactive Workplaces for Visual Data Exploration}},
author = {León, Gabriela Molina and Lischka, Michael and Luo, Wei and Breiter, Andreas},
year = {2022},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14551}
}