Draw your own story: Paper and pencil interactive storytelling

• We present a mixed reality interactive storytelling system.
• Users can freely interact by sketching objects on a sheet of paper.
• We validate the proposed system with a user study conducted with 21 participants.

Drawing is a primary human skill that has been used for thousands of years as a visual complement to written and oral storytelling. The advent of interactive narratives brings the possibility of interaction to the traditional stories. In this paper, we present a storytelling system able to dramatize interactive narratives in augmented reality over a conventional sheet of paper. The system allows users to freely interact with virtual characters by sketching objects on the paper. Users interacting with the system can thus indirectly affect the characters’ decisions, even to the point of radically subverting the storyline. We validate the proposed system with a user study conducted with 21 participants. The results show that the use of hand drawings as a form of interaction improves user satisfaction and experience and the system usability.