Finding decodable information that can be read out in behaviour

• DOI: 10.1016/j.neuroimage.2018.06.022
• Publication Date: 2018-06-07T16:49:36Z
• Authors: Tijl Grootswagers; Radoslaw M. Cichy; Thomas A. Carlson
• Keywords: Brain Mapping; brain; Brain; 006; Magnetic Resonance Imaging; image processing; 3. Good health; 03 medical and health sciences; 0302 clinical medicine; Pattern Recognition, Visual; XXXXXX - Unknown; Multivariate Analysis; Image Processing, Computer-Assisted; magnetic resonance imaging; Humans; Photic Stimulation

AbstractMultivariate decoding methods applied to neuroimaging data have become the standard in cognitive neuroscience for unravelling statistical dependencies between brain activation patterns and experimental conditions. The current challenge is to demonstrate that information decoded as such by the experimenter is in fact used by the brain itself to guide behaviour. Here we demonstrate a promising approach to do so in the context of neural activation during object perception and categorisation behaviour. We first localised decodable information about visual objects in the human brain using a spatially-unbiased multivariate decoding analysis. We then related brain activation patterns to behaviour using a machine-learning based extension of signal detection theory. We show that while there is decodable information about visual category throughout the visual brain, only a subset of those representations predicted categorisation behaviour, located mainly in anterior ventral temporal cortex. Our results have important implications for the interpretation of neuroimaging studies, highlight the importance of relating decoding results to behaviour, and suggest a suitable methodology towards this aim.