Applying 3D human model in a posture recognition system

This paper proposes an approach to recognise human postures in video sequences, which combines a 2D approach with a 3D human model. The 3D model is a realistic articulated human model which is used to obtain reference postures to compare with test postures. Several 2D approaches using different silhouette representations are compared with each other: projections of moving pixels on the reference axis, Hu moments and skeletonisation. We are interested in a set of specific postures which are representative of typical video understanding applications. We describe results for recognition of general postures (e.g. standing) and detailed postures (e.g. standing with one arm up) in ambiguous/optimal viewpoint with good/bad segmented silhouette to show the effectiveness of our approach.