University of Sussex
Browse

File(s) under permanent embargo

Designer led computational approach to generate mappings for devices with low gestural resolution

conference contribution
posted on 2023-06-09, 18:00 authored by Roberto Antonio Montano Murillo, Teng Han, Pourang Irani, Diego Martinez Plasencia, Sriram Subramanian
We present an approach for the semi-automatic generation of gesture mappings for devices with low gestural resolution such as the Myo Armband, an off-the-shelf EMG capture device. As an exemplar interactive task, we use text-entry: a pervasive and highly complex interaction. We quantify data related to interaction combining systematic studies (i.e., error, speed, accuracy) and semi-structured workshops with experts (e.g., cognitive load, heuristics). We then formalize these factors in a mathematical model and use optimization algorithms (i.e. simulated annealing) to find an optimum gesture mapping. We demonstrated our method in a text-entry application (i.e., complex interactive dialogue) comparing our approach with other computationally determined mappings using naive cost functions. Our results showed that the designers mapping (with all factors weighted by designers) presented a good balance on performance in all factors involved (speed, accuracy, comfort, memorability, etc.), consistently performing better than purely computational mappings. The results indicate that our hybrid approach can yield better results than either pure user-driven methodologies or pure data-driven approaches, for our application context featuring a large solution space and complex high-level factors.

History

Publication status

  • Published

File Version

  • Accepted version

Journal

Lecture Notes in Computer Science

ISSN

0302-9743

Publisher

Springer Verlag

Page range

623-643

Event name

Interact 2019: 17th IFIP TC.13 International Conference on Human-Computer Interaction

Event location

Paphos, Cyprus

Event type

conference

Event date

2 - 6 September 2019

Series

Information Systems and Applications, incl. Internet/Web, and HCI

Department affiliated with

  • Informatics Publications

Research groups affiliated with

  • Creative Technology Publications

Full text available

  • No

Peer reviewed?

  • Yes

Legacy Posted Date

2019-06-07

First Compliant Deposit (FCD) Date

2019-06-06

Usage metrics

    University of Sussex (Publications)

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC