Algorithms for two dimensional multi set canonical correlation analysis

Multi set canonical correlation analysis (mCCA), which extends the application of canonical correlation analysis (CCA) to more than two datasets, is a data driven technique that can jointly analyze the relationship amongst multiple (more than two) datasets. However, the conventional mCCA is directly applicable only to multivariate vector data and requires the image data to be reshaped into vectors. This approach fails to consider the spatial structure of the images and in addition, leads to an increase in the computational complexity. In this paper, we propose new two dimensional mCCA algorithms that operate directly on the image data instead of vectorizing them. Face recognition experiments are presented to compare the performances of conventional mCCA and the proposed two dimensional mCCA techniques. Additionally, experiments against fMRI data are conducted to demonstrate the applicability of the proposed approach in multisubject fMRI analysis.