File(s) under permanent embargo
Designer led computational approach to generate mappings for devices with low gestural resolution
conference contribution
posted on 2023-06-09, 18:00 authored by Roberto Antonio Montano Murillo, Teng Han, Pourang Irani, Diego Martinez Plasencia, Sriram SubramanianWe present an approach for the semi-automatic generation of gesture mappings for devices with low gestural resolution such as the Myo Armband, an off-the-shelf EMG capture device. As an exemplar interactive task, we use text-entry: a pervasive and highly complex interaction. We quantify data related to interaction combining systematic studies (i.e., error, speed, accuracy) and semi-structured workshops with experts (e.g., cognitive load, heuristics). We then formalize these factors in a mathematical model and use optimization algorithms (i.e. simulated annealing) to find an optimum gesture mapping. We demonstrated our method in a text-entry application (i.e., complex interactive dialogue) comparing our approach with other computationally determined mappings using naive cost functions. Our results showed that the designers mapping (with all factors weighted by designers) presented a good balance on performance in all factors involved (speed, accuracy, comfort, memorability, etc.), consistently performing better than purely computational mappings. The results indicate that our hybrid approach can yield better results than either pure user-driven methodologies or pure data-driven approaches, for our application context featuring a large solution space and complex high-level factors.
History
Publication status
- Published
File Version
- Accepted version
Journal
Lecture Notes in Computer ScienceISSN
0302-9743Publisher
Springer VerlagExternal DOI
Page range
623-643Event name
Interact 2019: 17th IFIP TC.13 International Conference on Human-Computer InteractionEvent location
Paphos, CyprusEvent type
conferenceEvent date
2 - 6 September 2019Series
Information Systems and Applications, incl. Internet/Web, and HCIDepartment affiliated with
- Informatics Publications
Research groups affiliated with
- Creative Technology Publications
Full text available
- No
Peer reviewed?
- Yes
Legacy Posted Date
2019-06-07First Compliant Deposit (FCD) Date
2019-06-06Usage metrics
Categories
No categories selectedLicence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC