Electrophysiological correlates and psychoacoustic characteristics of hearing-motion synaesthesia

Rothen, Nicolas, Bartl, Gergely Janos, Franklin, Anna and Ward, Jamie (2017) Electrophysiological correlates and psychoacoustic characteristics of hearing-motion synaesthesia. Neuropsychologia, 106. pp. 280-288. ISSN 0028-3932

[img] PDF - Accepted Version
Restricted to SRO admin only until 2 October 2018.

Download (793kB)

Abstract

People with hearing-motion synaesthesia experience sounds from moving or changing (e.g. flickering) visual stimuli. This phenomenon may be one of the most common forms of synaesthesia but it has rarely been studied and there are no studies of its neural basis. We screened for this in a sample of 200+ individuals, and estimated a prevalence of 4.2%. We also document its characteristics: it tends to be induced by physically moving stimuli (more so than static stimuli which imply motion or trigger illusory motion); and the psychoacoustic features are simple (e.g. “whooshing”) with some systematic correspondences to vision (e.g. faster movement is higher pitch). We demonstrate using event-related potentials that it emerges from early perceptual processing of vision. The synaesthetes have a higher amplitude motion-evoked N2 (165-185 msec), with some evidence of group differences as early as 55-75 msec. We discuss similarities between hearing-motion synaesthesia and previous observations that visual motion triggers auditory activity in the congenitally deaf. It is possible that both conditions reflect the maintenance of multisensory pathways found in early development that most people lose but can be retained in certain people in response to sensory deprivation (in the deaf) or, in people with normal hearing, as a result of other differences (e.g. genes predisposing to synaesthesia).

Item Type: Article
Keywords: Hearing; visual motion; EEG; synaesthesia/synesthesia; multisensory.
Schools and Departments: School of Psychology > Psychology
Depositing User: Ellena Adams
Date Deposited: 18 Sep 2017 14:51
Last Modified: 18 Oct 2017 15:45
URI: http://sro.sussex.ac.uk/id/eprint/70227

View download statistics for this item

📧 Request an update