Psychometric costs of retaking driving-related cognitive ability tests

- Practice effects were examined in four driving-related cognitive ability tests.
- Strict measurement invariance across test administration sessions was supported.
- Practice effects varied across driving-related cognitive ability tests.
- General mental ability moderated practice effects for more Gs-saturated tests.
- Practice effects did not generalize to broad cognitive speededness.

The present study tested predictions deduced from competing models advanced in the literature to explain practice effects in driving-related cognitive ability tests due to retesting. The models differ in terms of the processes assumed to be responsible for practice effects and make competing predictions with regard to the level measurement invariance across test administration sessions. A total of N = 239 test-takers solved four driving-related cognitive ability tests at three time-points of measurement. Item response theory analyses indicated that practice effects can be explained in terms of an increase in test-specific abilities. The size of the practice effect varied across driving-related cognitive ability tests and across test-takers' level of general mental ability. Latent mean and covariance structure analyses indicated that the observed improvements in test performance are purely test-specific and do not generalize to broad cognitive speededness.