A collection of challenging motion segmentation benchmark datasets

• A new challenging motion segmentation (MS) database with benchmark evaluation.
• 19 long and 162 short trajectory-based sequences with real distortions.
• 20 long and 150 short region-based sequences, with real distortions.
• A subset of 40 trajectory- and 34 region-based short sequences with complete data.
• Evaluation of long and short sequences with state-of-the-art MS algorithms.

An in-depth analysis of computer vision methodologies is greatly dependent on the benchmarks they are tested upon. Any dataset is as good as the diversity of the true nature of the problem enclosed in it. Motion segmentation is a preprocessing step in computer vision whose publicly available datasets have certain limitations. Some databases are not up-to-date with modern requirements of frame length and number of motions, and others do not have ample ground truth in them. In this paper, we present a collection of diverse multifaceted motion segmentation benchmarks containing trajectory- and region-based ground truth. These datasets enclose real-life long and short sequences, with increased number of motions and frames per sequence, and also real distortions with missing data. The ground truth is provided on all the frames of all the sequences. A comprehensive benchmark evaluation of the state-of-the-art motion segmentation algorithms is provided to establish the difficulty of the problem and to also contribute a starting point. All the resources of the datasets have been made publicly available at http://dixie.udg.edu/udgms/.