An advanced MRI and MRSI data fusion scheme for enhancing unsupervised brain tumor differentiation

Proton Magnetic Resonance Spectroscopic Imaging (1H MRSI) has shown great potential in tumor diagnosis since it provides localized biochemical information discriminating different tissue types, though it typically has low spatial resolution. Magnetic Resonance Imaging (MRI) is widely used in tumor diagnosis as an in vivo tool due to its high resolution and excellent soft tissue discrimination. This paper presents an advanced data fusion scheme for brain tumor diagnosis using both MRSI and MRI data to improve the tumor differentiation accuracy of MRSI alone. Non-negative Matrix Factorization (NMF) of the spectral feature vectors from MRSI data and the image fusion with MRI based on wavelet analysis are implemented jointly. Hence, it takes advantage of the biochemical tissue discrimination of MRSI as well as the high resolution of MRI. The feasibility of the proposed frame work is validated by comparing with the expert delineations, giving mean correlation coefficients for the tumor source of 0.97 and the Dice score of tumor region overlap of 0.90. These results compare favorably against those obtained with a previously proposed NMF method where MRSI and MRI are integrated by stacking the MRSI and MRI features.