A method of two-handed gesture interactions with applications based on commodity devices

Recent progress on human–computer interface technology has enabled more intuitive and natural communications between humans and sensor-based devices in many fields such as games, e-learning, augmented reality (AR), and medical image processing. While traditional human–computer interface devices such as the keyboard and mouse still dominate in our daily life, we propose a new method of two-handed gesture interactions to control applications based on commodity devices such as Wiimote, the primary controller for Nintendo’s Wii game console. Our main goal is to construct a unified way to interact with computers and their application systems just like using home appliances. The proposed system allows users to track their fingers moving in three-dimensional space in real time and define each gesture’s function by using the commodity devices.