Lessons from hands-free data entry in flexible cystoscopy with Glass for future smart assistance

Templeman, Charles, Ordonez Morales, Francisco Javier, Ciliberto, Mathias, Symes, Andrew and Roggen, Daniel (2020) Lessons from hands-free data entry in flexible cystoscopy with Glass for future smart assistance. In: Chen, Feng, García-Betances, Rebaca I, Chen, Liming, Cabrera-Umpiérrez, María Fernanda and Nugent, Chris (eds.) Smart assisted living: toward an open smart-home infrastructure. Computer Communications and Networks . Springer International Publishing, Switzerland, pp. 63-87. ISBN 9783030255893

[img] PDF - Accepted Version
Restricted to SRO admin only

Download (1MB)


We explore how Google Glass can be used to annotate cystoscopy findings in a hands-free and reproducible manner by surgeons during operations in the sterile environment inspired by the current practice of hand-drawn sketches. We present three data entry variants involving head movements and speech input. In an experiment with 8 surgeons and Foundation Doctors having up to 30 years’ cystoscopy experience at a UK hospital we assessed the feasibility, benefits and draw-backs of the system. We report data entry speed and error rate of input modalities and contrast it with the participants’ feedback on their perception of usability, acceptance, and suitability for deployment. These results offer an expanded analysis of the participants’ feedback compared to a previous analysis. The results highlight the potential of new data entry technologies and point out directions for future improvement of eyewear computers. The findings can be generalised to other endoscopic procedures (e.g. OGD/laryngoscopy) and could be included with-in hospital IT in the future. The source code of the Glass application is available at https://github.com/sussexwearlab/GlassMedicalDataEntry.

Item Type: Book Section
Schools and Departments: School of Engineering and Informatics > Engineering and Design
Research Centres and Groups: Sensor Technology Research Centre
Subjects: T Technology
Depositing User: Daniel Roggen
Date Deposited: 05 Aug 2019 13:34
Last Modified: 10 Feb 2020 12:41
URI: http://sro.sussex.ac.uk/id/eprint/85277

View download statistics for this item

📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
MinlAttention: Attention Management in Minimal Invasive SurgeryG1830BUNDESMINISTERIUM F�R VERKEHR, INNOVATION UND TECHNOLOGIEUnset