Combining the spectral PCA and spatial PCA fusion methods by an optimal filter

• This paper uses an optimal filter to combine the PCA based methods.
• The optimal filters have been designed based on the MSE and CC criteria.
• The proposed method preserves more spectral and spatial information.

High correlation among the neighboring pixels, both spectrally and spatially in a multispectral image makes it indispensable to use relevant data transformation approaches, before performing image fusion. The principal component analysis (PCA) method has been a popular choice for the spectral transformation. To propose a new consistent data transformation method in spatial domain, this paper applies the PCA transform to the spatial information of the neighboring pixels. Owing to the fact that the coefficients of PCA are obtained from statistical properties of data, they are adaptive and robust. Then, a new hybrid algorithm is proposed combining the spectral PCA and spatial PCA methods, by an optimal filter to make the synthesized result more similar to what the corresponding multisensors would observe at the high-resolution level. The evaluation of the pan-sharpened images, using global validation indexes, reveals that the proposed approach improves the fusion quality compared with six state of the art fusion methods.