Switching modalities in a sentence verification task: ERP evidence for embodied language processing

Hald, Lea A, Marshall, Julie-Ann, Janssen, Dirk P and Garnham, Alan (2011) Switching modalities in a sentence verification task: ERP evidence for embodied language processing. Frontiers in Psychology, 2 (45). pp. 1-15. ISSN 1664-1078

PDF - Published Version
Download (1MB) | Preview


In an event related potential (ERP) experiment using written language materials only, we investigated a potential modulation of the N400 by the modality switch effect. The modality switch effect occurs when a first sentence, describing a fact grounded in one modality, is followed by a second sentence describing a second fact grounded in a different modality. For example, "A cellar is dark" (visual), was preceded by either another visual property "Ham is pink" or by a tactile property "A mitten is soft." We also investigated whether the modality switch effect occurs for false sentences ("A cellar is light"). We found that, for true sentences, the ERP at the critical word "dark" elicited a significantly greater frontal, early N400-like effect (270370 ms) when there was a modality mismatch than when there was a modality-match. This pattern was not found for the critical word "light" in false sentences. Results similar to the frontal negativity were obtained in a late time window (500700 ms). The obtained ERP effect is similar to one previously obtained for pictures. We conclude that in this paradigm we obtained fast access to conceptual properties for modality-matched pairs, which leads to embodiment effects similar to those previously obtained with pictorial stimuli.

Item Type: Article
Schools and Departments: School of Psychology > Psychology
Depositing User: Alan Garnham
Date Deposited: 06 Feb 2012 15:32
Last Modified: 02 Jul 2019 19:50
URI: http://sro.sussex.ac.uk/id/eprint/13136

View download statistics for this item

📧 Request an update