Investigating Player Behavior and Experience in Speech-enabled Multimodal Video Games

By David Thornton and Juan Gilbert.

Published by The Technology Collection

Format Price
Article: Print $US10.00
Article: Electronic $US5.00

This paper describes a study of video game control schemes. We performed a study of two versions of a video game, the first employing the standard joystick controller (unimodal), the second a combination of joystick and speech-based cursor control mechanisms (multimodal). Eighty subjects played an original video game, called Shepherd Shuffle, whose objective was to herd a group of sheep into a holding pen as quickly as possible. The two versions were compared based on performance and usage metrics as well as a model of Mihaly Csikszentmihalyi’s concept of “Flow”.

Keywords: Multimodal Interfaces, Speech-based Control, Digital Gaming, Flow

International Journal of Technology, Knowledge and Society, Volume 7, Issue 1, pp.165-178. Article: Print (Spiral Bound). Article: Electronic (PDF File; 1.564MB).

David Thornton

Assistant Professor, Mathematical, Computing, and Information Sciences, Jacksonville State University, Jacksonville, AL, USA

David Thornton is an Assistant Professor at Jacksonville State University (JSU) in Jacksonville, AL, USA. He received a B.S. in Computer Science from JSU in 2001 and an M.S. in Systems and Software Design from JSU in 2003. In 2008, he received a Ph.D. in Computer Science from Auburn University in Auburn, AL. His research interests include game design, speech-enabled systems, and usability.

Juan Gilbert

IDEaS Professor and Chair of the Human-Centered Computing Division in the School of Computing, School of Computing, Clemson University, Clemson, SC, USA

Dr. Juan E. Gilbert is also a Fellow of the American Association for the Advancement Science (AAAS), an ACM Distinguished Scientist, National Associate of the National Research Council of the National Academies, an ACM Distinguished Speaker and a Senior Member of the IEEE Computer Society. He has active research projects in Human-Computer Interaction, Spoken Language Systems, Accessibility and Data Mining.


There are currently no reviews of this product.

Write a Review