Measurement invariance in training evaluation: Old question, new context

Technological advances that have been put to use by organizations have not escaped the training domain. With the shift towards computer-mediated surveys, training evaluations have been converted from traditional paper-and-pencil formats to Web-based environments. This begs the question as to whether or not these modalities are equivalent. Accordingly, this study examined the item functioning of parallel Web-based training evaluations and traditional paper-and-pencil evaluations of a training intervention. Item response theory (IRT) analyses revealed few differences between how an individual would respond to particular items (i.e., differential item functioning) regardless of the modality employed to complete a training evaluation. This provides evidence for the equivalence of paper-and-pencil and computer-mediated training evaluations.

► Examined the item functioning of parallel Web-based training and traditional paper-and-pencil evaluations.
► Item response theory (IRT) analyses revealed few differences between mediums.
► Confirms equivalence of paper-and-pencil and computer-mediated training evaluations.