Robust pose invariant face recognition using coupled latent space discriminant analysis

We propose a novel pose-invariant face recognition approach which we call Discriminant Multiple Coupled Latent Subspace framework. It finds the sets of projection directions for different poses such that the projected images of the same subject in different poses are maximally correlated in the latent space. Discriminant analysis with artificially simulated pose errors in the latent space makes it robust to small pose errors caused due to a subject’s incorrect pose estimation. We do a comparative analysis of three popular latent space learning approaches: Partial Least Squares (PLSs), Bilinear Model (BLM) and Canonical Correlational Analysis (CCA) in the proposed coupled latent subspace framework. We experimentally demonstrate that using more than two poses simultaneously with CCA results in better performance. We report state-of-the-art results for pose-invariant face recognition on CMU PIE and FERET and comparable results on MultiPIE when using only four fiducial points for alignment and intensity features.

► We show that latent space methods are effective for pose-invariant-face recognition. ► We compare popular latent space techniques for pose-invariant-face recognition. ► We adapt latent space methods to allow for errors in pose determination. ► We propose a two-layer architecture to counter pose determination error. ► We show strong experimental results on CMU PIE, MultiPIE, and FERET.