Predicting IQ change from brain structure: A cross-validation study

•We quantify how well IQ changes in teenagers can be predicted from brain scans.•We compare different ways to cross-validate predictions from neuroimaging.•We demonstrate the advantage of using Leave-One-Out cross-validation.•We illustrate the limitations of using IQ as a measure of cognitive potential.

Procedures that can predict cognitive abilities from brain imaging data are potentially relevant to educational assessments and studies of functional anatomy in the developing brain. Our aim in this work was to quantify the degree to which IQ change in the teenage years could be predicted from structural brain changes. Two well-known k-fold cross-validation analyses were applied to data acquired from 33 healthy teenagers - each tested at Time 1 and Time 2 with a 3.5 year interval. One approach, a Leave-One-Out procedure, predicted IQ change for each subject on the basis of structural change in a brain region that was identified from all other subjects (i.e., independent data). This approach predicted 53% of verbal IQ change and 14% of performance IQ change. The other approach used half the sample, to identify regions for predicting IQ change in the other half (i.e., a Split half approach); however - unlike the Leave-One-Out procedure - regions identified using half the sample were not significant. We discuss how these out-of-sample estimates compare to in-sample estimates; and draw some recommendations for k-fold cross-validation procedures when dealing with small datasets that are typical in the neuroimaging literature.