Fingertip-based interactive projector-camera system

Most current challenge of hand touch detection in interactive projector system is how to recover the 3D information of fingertips with a single camera. In this paper, a projector-camera system is proposed that enables users to interact with computer by touching on arbitrary surfaces with bare-hand. The realization of touch detection is through a novel vision-based algorithm performing in three steps: (1) foreground extraction based on predicted image generated from geometric and photometric calibration matrix; (2) fingertip detection by the curvature of hand contour points; (3) touch detection by active vision. Extensive experiments on foreground extraction, fingertip detection, and touch judgment are presented to show the robust performance of this system.