Retrieval of logically relevant 3D human motions by Adaptive Feature Selection with Graded Relevance Feedback

A system that can retrieve logically relevant 3D captured motions is useful in game and animation production. We presented a robust logical relevance metric based on the relative distances among the joints. Existing methods select a universal subset of features for all kinds of queries which may not well characterize the variations in different queries. To break through this limitation we proposed an Adaptive Feature Selection (AFS) method that abstracts the characteristics of the query by a Linear Regression Model, and different feature subsets can be selected according to the properties of the specific query. With a Graded Relevance Feedback (GRF) algorithm, we refined the feature subset that enhances the retrieval performance according to the graded relevance of the feedback samples. With an ontology that predefines the logical relevance between motion classes in terms of graded relevance, the performance of the proposed AFS–GRF algorithm is evaluated and shown to outperform other class-specific feature selection and motion retrieval methods.

► Variance of joint relative distance can capture logical relevance of human motions. ► Adaptive Feature Selection is proposed to extract query-specific feature. ► Our proposed Graded Relevance Feedback further enhances the retrieval performance. ► Our proposed method outperforms other feature selection and motion retrieval methods. ► We implement a prototype motion retrieval system to illustrate our proposed method.