Stereoscopic video surveillance system for detection of target’s 3D location coordinates and moving trajectories

In this paper, a novel stereoscopic video surveillance system to track a target person and detect its three-dimensional (3D) location coordinates and moving trajectory is implemented by using the pan/tilt-controlled stereo camera system. Stereoscopic video images of a target person are captured with stereo camera system and the target face and its location in the left image plane can be detected by use of YCbCr color model and centroid method. Also the target location in the right image plane can be obtained through correlation between the left face image and the right image by using the binary phase extraction joint transform correlator (BPEJTC) algorithm. With these location data of the target face in the left and right image planes the pan/tilt systems can control the stereo camera to track a target person by positioning the target face at the center of the camera’s FOV and making the focusing points of the right and left camera coincided on the target face. And then, with the resultant pan/tilt angles and geometric parameters of the stereo camera system, the target’s real 3D location coordinates and moving trajectory in the world space can be obtained. From some experiments with 900 frames of stereoscopic video image pairs, it is analyzed that the target’s center location after being tracked is kept to be very low error ratio of 0.62%, 2.04% on the average in the x, y directions of the image plane, respectively. Also, the error ratio between the calculated and measured values of the 3D location coordinates of a target person is found to be very low value of 2.1%, 5.7% on the average in the X and Y directions of the real world space, respectively.