Scale Object Selection (SOS) through a hierarchical segmentation by a multi-spectral per-pixel classification

• Several scales of detail have been considered using of a hierarchical segmentation.
• Spectral information has been accounted by a per-pixel classifier.
• SOS algorithm selects for each class the spatial scale that maximizes the classification accuracy.

In high resolution multispectral optical data, the spatial detail of the images are generally smaller than the dimensions of objects, and often the spectral signature of pixels is not directly representative of classes we are interested in. Thus, taking into account the relations between groups of pixels becomes increasingly important, making object-oriented approaches preferable. In this work several scales of detail within an image are considered through a hierarchical segmentation approach, while the spectral information content of each pixel is accounted by a per-pixel classification. The selection of the most suitable spatial scale for each class is obtained by merging the hierarchical segmentation and the per-pixel classification through the Scale Object Selection (SOS) algorithm. The SOS algorithm starts processing data from the highest level of the hierarchical segmentation, which has the least amount of spatial detail, down to the last segmentation map. At each segmentation level, objects are assigned to a specific class whenever the percentage of pixels belonging to the latter, according to a pixel-based procedure, exceeds a predefined threshold, thereby automatically selecting the most appropriate spatial scale for the classification of each object. We apply our method to multispectral, panchromatic and pan-sharpened QuickBird images, considering two different test cases: a region on the Etna volcano (Italy), imaged at a 2.4 m resolution, and an area close to the town of Balakot (Pakistan), imaged at a 0.6 m resolution. On both test-cases the proposed approach enhanced the classification accuracy with respect to the single-segmentation per-pixel classification approach. A detailed analysis of the benefits achieved using the hierarchical segmentation with respect to a single segmentation is reported.