Fusion of hyperspectral and LIDAR data using decision template-based fuzzy multiple classifier system

Regarding to the limitations and benefits of remote sensing sensors, fusion of remote sensing data from multiple sensors such as hyperspectral and LIDAR (light detection and ranging) is effective at land cover classification. Hyperspectral images (HSI) provide a detailed description of the spectral signatures of classes, whereas LIDAR data give height detailed information. However, because of the more complexities and mixed information in LIDAR and HSI, traditional crisp classification methods could not be more efficient. In this situation, fuzzy classifiers could deliver more satisfactory results than crisp classification approaches. Also, referring to the limitation of single classifiers, multiple classifier system (MCS) may exhibit better performance in the field of multi-sensor fusion. This paper presents a fuzzy multiple classifier system for fusions of HSI and LIDAR data based on decision template (DT). After feature extraction and feature selection on each data, all selected features of both data are applied on a cube. Then classifications were performed by fuzzy k-nearest neighbour (FKNN) and fuzzy maximum likelihood (FML) on cube of features. Finally, a fuzzy decision fusion method is utilized to fuse the results of fuzzy classifiers. In order to assess fuzzy MCS proposed method, a crisp MCS based on support vector machine (SVM), KNN and maximum likelihood (ML) as crisp classifiers and naive Bayes (NB) as crisp classifier fusion method is applied on selected cube feature. A co-registered HSI and LIDAR data set from Houston of USA was available to examine the effect of proposed MCSs. Fuzzy MCS on HSI and LIDAR data provide interesting conclusions on the effectiveness and potentialities of the joint use of these two data.