A pen and speech-based storytelling system for Chinese children

Storytelling plays an important role in language learning. Storytelling by a child, as an educational activity, influences the child’s linguistic ability, thought process, imagination, and creativity significantly. Many researchers have made extensive studies in storytelling systems for children. While there presently exist many software-based storytelling applications, most are deemed not completely suitable for Chinese children. In this paper, combining the characteristics of Chinese children and using the multimodal interaction pattern based on speech and pen-gesture, we present children a 3D storytelling system which uses user-centered scenario-based design method. The usability of the storytelling system is evaluated and the results suggest that all the users generally feel pretty satisfied with the system.