The role of visual experience in the emergence of cross-modal correspondences

Hamilton-Fletcher, Giles, Pisanski, Katarzyna, Reby, David, Stefańczyk, Michal, Ward, Jamie and Sorokowska, Agnieszka (2018) The role of visual experience in the emergence of cross-modal correspondences. Cognition, 175. pp. 114-121. ISSN 0010-0277

[img] PDF - Accepted Version
Restricted to SRO admin only until 16 March 2019.
Available under License Creative Commons Attribution-NonCommercial No Derivatives.

Download (616kB)

Abstract

Cross-modal correspondences describe the widespread tendency for attributes in one sensory modality to be consistently matched to those in another modality. For example, high pitched sounds tend to be matched to spiky shapes, small sizes, and high elevations. However, the extent to which these correspondences depend on sensory experience (e.g. regularities in the perceived environment) remains controversial. Two recent studies involving blind participants have argued that visual experience is necessary for the emergence of correspondences, wherein such correspondences were present (although attenuated) in late blind individuals but absent in the early blind. Here, using a similar approach and a large sample of early and late blind participants (N=59) and sighted controls (N=63), we challenge this view. Examining five auditory-tactile correspondences, we show that only one requires visual experience to emerge (pitch-shape), two are independent of visual experience (pitch-size, pitch-weight), and two appear to emerge in response to blindness (pitch-texture, pitch-softness). These effects tended to be more pronounced in the early blind than late blind group, and the duration of vision loss among the late blind did not mediate the strength of these correspondences. Our results suggest that altered sensory input can affect cross-modal correspondences in a more complex manner than previously thought and cannot solely be explained by a reduction in visually-mediated environmental correlations. We propose roles of visual calibration, neuroplasticity and structurally-innate associations in accounting for our findings.

Item Type: Article
Keywords: Blindness; Cross-modal correspondences; Pitch; Sound; Touch.
Schools and Departments: School of Psychology > Psychology
Depositing User: Ellena Adams
Date Deposited: 05 Mar 2018 11:03
Last Modified: 04 Jul 2018 11:12
URI: http://sro.sussex.ac.uk/id/eprint/74197

View download statistics for this item

📧 Request an update