Integration of 3D multimodal imaging data of a head and neck cancer and advanced feature recognition

• Multimodal image analysis of head and neck cancer was performed.
• MALDI MS images, H&E and immunohistochemically stained histological images were combined.
• Segmentation of MALDI data allows correlation to histo-pathological findings.
• Nonlinear image registration serves as basis for 3D reconstruction of tissue.
• 3D reconstruction of different modalities allows insight into cancer progression.

In the last years, matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) became an imaging technique which has the potential to characterize complex tumor tissue. The combination with other modalities and with standard histology techniques was achieved by the use of image registration methods and enhances analysis possibilities.We analyzed an oral squamous cell carcinoma with up to 162 consecutive sections with MALDI MSI, hematoxylin and eosin (H&E) staining and immunohistochemistry (IHC) against CD31.Spatial segmentation maps of the MALDI MSI data were generated by similarity-based clustering of spectra. Next, the maps were overlaid with the H&E microscopy images and the results were interpreted by an experienced pathologist. Image registration was used to fuse both modalities and to build a three-dimensional (3D) model. To visualize structures below resolution of MALDI MSI, IHC was carried out for CD31 and results were embedded additionally.The integration of 3D MALDI MSI data with H&E and IHC images allows a correlation between histological and molecular information leading to a better understanding of the functional heterogeneity of tumors.This article is part of a Special Issue entitled: MALDI Imaging, edited by Dr. Corinna Henkel and Prof. Peter Hoffmann.

© Fraunhofer Institute for Medical Image Computing MEVIS.Figure optionsDownload high-quality image (225 K)Download as PowerPoint slide