Raising awareness about measurement error in research on unconscious mental processes

Vadillo, Miguel A, Malejka, Simone, Lee, Daryl Y H, Dienes, Zoltan and Shanks, David R (2021) Raising awareness about measurement error in research on unconscious mental processes. Psychonomic Bulletin and Review. ISSN 1069-9384 (Accepted)

[img] PDF - Accepted Version
Restricted to SRO admin only

Download (1MB)

Abstract

Experimental psychologists often neglect the poor psychometric properties of the dependent measures collected in their studies. In particular, a low reliability of measures can have dramatic consequences for the interpretation of key findings in some of the most popular experimental paradigms, especially when strong inferences are drawn from the absence of statistically significant correlations. In research on unconscious cognition, for instance, it is commonly argued that the lack of a correlation between task performance and measures of awareness or explicit recollection of the target stimuli provides strong support for the conclusion that the cognitive processes underlying performance must be unconscious. Using contextual cuing of visual search as a case study, we show that given the low reliability of the dependent measures collected in these studies, it is usually impossible to draw any firm conclusion about the unconscious character of this effect from correlational analyses. Furthermore, both a psychometric meta-analysis of the available evidence and a cognitive-modeling approach suggest that, in fact, we should expect to see very low correlations between performance and awareness at the empirical level, even if both constructs are perfectly related at the latent level. Convincing evidence for the unconscious character of contextual cuing and other effects will most likely demand richer and larger datasets, coupled with more powerful analytic approaches.

Item Type: Article
Schools and Departments: School of Psychology > Psychology
SWORD Depositor: Mx Elements Account
Depositing User: Mx Elements Account
Date Deposited: 26 Mar 2021 08:58
Last Modified: 26 Mar 2021 09:00
URI: http://sro.sussex.ac.uk/id/eprint/98057

View download statistics for this item

📧 Request an update