Replacing Paper-based Testing with Computer-based Testing in Assessment: Are we Doing Wrong?

The standards for developing computerized-assessment required equivalent test scores to be established for the paper- based test (PBT) and computer-based test (CBT) modes. However, in most studies, the two modes were nearly identical, yet significant differences of test scores were observed. Therefore the validity of replacing PBT with CBT in educational assessment was questioned. This study employed an achievement test, a psychological test and a motivation questionnaire in a Solomon four-group design to examine validity of the CBT and its effects on test performance and motivation. The findings of this study provide evidences for the issue of CBT's validity in educational and psychological assessment.