“I always wanted to see the night sky”: blind user preferences for Sensory Substitution Devices

Hamilton-Fletcher, Giles, Obrist, Marianna, Watten, Phil, Mengucci, Michele and Ward, Jamie (2016) “I always wanted to see the night sky”: blind user preferences for Sensory Substitution Devices. In: ACM CHI Conference on human factors in computing systems (CHI 2016), May 7-12, 2016, San Jose, CA, USA.

[img] PDF - Accepted Version
Download (1MB)

Abstract

Sensory Substitution Devices (SSDs) convert visual information into another sensory channel (e.g. sound) to improve the everyday functioning of blind and visually impaired persons (BVIP). However, the range of possible functions and options for translating vision into sound is largely open-ended. To provide constraints on the design of this technology, we interviewed ten BVIPs who were briefly trained in the use of three novel devices that, collectively, showcase a large range of design permutations. The SSDs include the ‘Depth-vOICe,’ ‘Synaestheatre’ and ‘Creole’ that offer high spatial, temporal, and colour resolutions respectively via a variety of sound outputs (electronic tones, instruments, vocals). The participants identified a range of practical concerns in relation to the devices (e.g. curb detection, recognition, mental effort) but also highlighted experiential aspects. This included both curiosity about the visual world (e.g. understanding shades of colour, the shape of cars, seeing the night sky) and the desire for the substituting sound to be responsive to movement of the device and aesthetically engaging.

Item Type: Conference or Workshop Item (Paper)
Keywords: Sensory substitution, Vision, Depth, Colour, Hearing, Sound, Blind, Visually impaired, Experience, Design, SSD
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: B Philosophy. Psychology. Religion > BF Psychology > BF0231 Sensation. Aesthesiology > BF0241 Special senses. Vision. Visual perception
T Technology > T Technology (General)
Depositing User: Marianna Obrist
Date Deposited: 11 Apr 2016 15:18
Last Modified: 30 Aug 2017 11:57
URI: http://sro.sussex.ac.uk/id/eprint/60416

View download statistics for this item

📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
Seeing the World through Sound: Developing Multi-Sensory Technology for Young Blind PeopleG1478UNIVERSITY OF SUSSEXUnset
SenseX - Sensory Experiences for Interactive TechnologiesG1589EUROPEAN UNIONH2020-ERC-2014-STG-638605