Measuring rater judgments within learning assessments-Part 2: A mixed approach to creating rubrics

Assessments will focus learning, and hence they should be aligned with desired educational outcomes. Frequently human raters (experts) are needed to judge a variety of advanced learners׳ abilities. To use subjective human judgments effectively, this second part of a two-part article in the Methodology Matters section considers the use of a mixed approach to rubric creation. Prior empirical research further introduces this mixed approach while dual-processing theory helps explain it. Applications and implications are discussed. After reading this article, the readers should be able to (a) recognize the differences between holistic and analytic rubrics, (b) discuss integration with cognition and dual-processing theory, and (c) create a rubric for a learning assessment, using a mixed approach.