Adaptive visual target detection and tracking using weakly supervised incremental appearance learning and RGM-PHD tracker

• A multiple visual target detection and tracking system is proposed.
• Relative keypoint-based appearance model is proposed for visual targets.
• Incremental learning method with weak supervision is introduced to update target appearances.
• The appearance-based detector is proposed in conjunction with background subtraction detector.
• RGM-PHD tracker is combined with the detectors to keep the trajectories of targets.

Multiple visual target tracking is a challenging problem due to various uncertainties including occlusion, miss-detection and noisy measurement. Most tracking approaches utilize an object-specific detector, pre-trained on many labeled images, to provide suitable measurements for their tracking system. In this paper, we use a simple background subtraction detector which only needs the background image to localize targets independent of their shape or type. In order to cope with the uncertainties resulted by the detector, we propose an adaptive appearance model and develop an incremental appearance learning algorithm to learn the target appearances in time. The proposed method employs the background information and our defined keypoints’ miss-matched history to adapt the target appearances within different frames. Furthermore, we combine Refined Gaussian Mixture Probability Hypothesis Density (RGM-PHD) tracker with the detectors to keep target trajectories and handle uncertainties. The experiments conducted on several video datasets show the effectiveness of our proposed method.

Figure optionsDownload high-quality image (101 K)Download as PowerPoint slide