Measuring instructed language learners’ IC development: Discrepancies between assessment models by Byram and Bennett

Researchers and foreign language (FL) educators alike have investigated changes in learners’ intercultural competence (IC) in response to pedagogical interventions aimed at preparing learners for cross-cultural encounters. Byram's (1997) multimodal IC model and Bennett's (1993) developmental model of intercultural sensitivity (DMIS) are predominant IC assessment models in the field of FL education. This paper reports empirical evidence that reveals discrepancies between these two models drawing from the findings of a larger study that employed both theoretical lenses to investigate culture learning in a computer-mediated environment. Specifically, the study investigated changes in the way 13 U.S. French language learners talked about French people and culture in online classroom discussions in response to virtual instruction about French cultural practices at two levels: (1) at the individual level—with Byram's IC model in three case studies and (2) at the group level—with Bennett's DMIS. A post hoc comparison of the findings revealed assessment discrepancies between the models—empirical evidence revealing contradictions both between and within the models. These discrepancies are reported and the merits of each model within the research design are discussed. The aim of this paper is to empower readers with an understanding of IC research instruments and assessment tools commonly used to measure IC development in FL education and to inform methodological decisions of future research.