Visual tracking by proto-objects

In this paper, we propose a biologically inspired framework of visual tracking based on proto-objects. Given an image sequence, proto-objects are first detected by combining saliency map and topic model. Then the target is tracked based on spatial and saliency information of the proto-objects. In the proposed Bayesian approach, states of the target and proto-objects are jointly estimated over time. Gibbs sampling has been used to optimize the estimation during the tracking process. The proposed method robustly handles occlusion, distraction, and illumination change in the experiments. Experimental results also demonstrate that the proposed method outperforms the state-of-the-art methods in challenging tracking tasks.

► This work presents a biologically inspired framework of visual tracking based on salient proto-objects. ► During the tracking process, states of the target and proto-objects are jointly estimated over time. ► Experimental results demonstrate that the proposed method outperforms state-of-the art methods in challenging tracking tasks. ► To authors' knowledge, the approach of tracking by proto-objects is first introduced in this work.