Predictive validity evidence for an assessment program based on the Work Sampling System in mathematics and language and literacy

This study examined the predictive nature of teacher ratings of student performance on the mathematical thinking and language and literacy domains of a state mandated curriculum-embedded performance assessment for children in first grade to student achievement on a criterion-referenced test in third grade in mathematics and English language arts, using a multilevel modeling approach. The sample included 1,281 elementary school children nested within 132 classrooms in an urban school district in South Carolina. Results showed positive associations between first grade teacher ratings and students’ third grade achievement. However, first grade teacher ratings were not found to uniquely contribute to the proportion of explained variance in third grade performance on a high-stakes statewide assessment, over and above student demographic variables.