Multi-view action recognition based on action volumes, fuzzy distances and cluster discriminant analysis

In this paper, we present a view-independent action recognition method exploiting a low computational-cost volumetric action representation. Binary images depicting the human body during action execution are accumulated in order to produce the so-called action volumes. A novel time-invariant action representation is obtained by exploiting the circular shift invariance property of the magnitudes of the Discrete Fourier Transform coefficients. The similarity of an action volume with representative action volumes is exploited in order to map it to a lower-dimensional feature space that preserves the action class properties. Discriminant learning is, subsequently, employed for further dimensionality reduction and action class discrimination. By using such an action representation, the proposed approach performs fast action recognition. By combining action recognition results coming from different view angles, high recognition rates are obtained. The proposed method is extended to interaction recognition, i.e., to human action recognition involving two persons. The proposed approach is evaluated on a publicly available action recognition database using experimental settings simulating situations that may appear in real-life applications, as well as on a new nutrition support action recognition database.

► We perform view-invariant action recognition utilizing a multi-camera setup. ► Actions are modeled as 3D shapes, the so-called action volumes. ► FVQ and CDA are combined in order to obtain a discriminant action representation. ► Action classification is performed independently for all the available cameras. ► By combining action classification results, high recognition accuracy is obtained.