Plant leaf detection using modified active shape models

We propose an in situ detection method of multiple leaves with overlapping and occlusion in greenhouse conditions. Initially a multilayer perceptron (MLP) is used to classify partial boundary images of pepper leaves. After the partial leaf boundary detection, active shape models (ASMs) are subsequently built to employ the images of entire leaves based on a priori knowledge using landmark. Two deformable models were developed with pepper leaves: Boundary-ASM and MLP-ASM. Matching processes are carried out by deforming the trained leaf models to fit real leaf images collected in the greenhouse. MLP-ASM detected 76.7 and 87.8% of overlapping and occluded pepper leaves respectively, while Boundary-ASM showed detection rates of 63.4 and 76.7%. The detection rates by the conventional ASM were 23.3 and 29.3%. The leaf models trained with pepper leaves were further tested with leaves of paprika, in the same family but with more complex shapes (e.g., holes and rolling). Although the overall detection rates were somewhat lower than those for pepper, the rates for the occluded and overlapping leaves of paprika were still higher with MLP-ASM (ranging from 60.4 to 76.7%) and Boundary-ASM (ranging from 50.5 to 63.3%) than using the conventional active shape model (from 21.6 to 30.0%). The modified active shape models with the boundary classifier could be an efficient means for detecting multiple leaves in field conditions.