The effects of animated pedagogical agents in an English-as-a-foreign-language learning environment

• We investigated degrees of APA embodiment in CALL systems.
• We implemented a CALL system and an Animated Pedagogical Agent for Brazilian students.
• Gain scores from using different APA versions were compared to analyze agent effects.
• Modality and Embodied Effects were found, Image and Expressiveness Effects were not.

Animated pedagogical agents (APAs) have frequently been used as a powerful addition to learning environments, since APAs have been known to facilitate learning. APAs can present various features, such as voice, movements, gestures and pointing, and researchers have sought to verify specifically which features of agents effectively contribute to learning. Previous studies have studied these features by comparing different degrees of agent embodiment in the evaluation of the image effect (i.e., students learn more when learning systems have visual APAs), the embodied agent effect (i.e., fully embodied agents that deliver instruction aurally and use gestures to improve learning outcomes in text-only learning systems), the modality effect (i.e., oral instruction contributes to the learning process), and the expressiveness effect (i.e., fully embodied agents promote more effective learning than static ones). Some of these studies have investigated the image, embodied agent and modality effects in the same learning environment, but they were not the same studies that investigated the expressiveness effect. The expressiveness effect allows us to separate the movements of the agent from its other features, such as the agent's image, so investigating this effect is as important as investigating the other effects. We are not aware of any studies that investigated all of these four effects within the same learning system, nor that evaluated any of these effects in language learning environments. Accordingly, this paper describes the design, implementation, and analysis of an APA designed to evaluate the abovementioned effects. The APA was integrated into a computer-assisted language learning (CALL) system to teach English as a foreign language to Brazilian students. A total of 72 Brazilian undergraduate students were divided into four groups, each of which used a different version of the APA in the same CALL system: no agent, a voice-only agent, a static agent, or a fully embodied agent. We compared students’ gain scores (i.e., difference between pre- and posttest scores) across groups to evaluate each of the four effects. Though the outcomes of our study supported the presence of the embodied agent and modality effects, we were not able to demonstrate the image or expressiveness effects in the experiment. Our results indicate that the voice of the agent might contribute more positively to learning than movements, gestures and pointing.