Improving kNN multi-label classification in Prototype Selection scenarios using class proposals

• Improving Prototype Selection-based classification proposing likely labels of the reduced set.
• kNN search within the original training set restricted to those proposed labels.
• Scheme that provides a broad range of solution in the trade-off accuracy efficiency.
• Cost reduction in multi-label classification scenarios and robustness against noise.
• Our approach gets to reach accuracy of kNN with barely a third of distances computed.

Prototype Selection (PS) algorithms allow a faster Nearest Neighbor classification by keeping only the most profitable prototypes of the training set. In turn, these schemes typically lower the performance accuracy. In this work a new strategy for multi-label classifications tasks is proposed to solve this accuracy drop without the need of using all the training set. For that, given a new instance, the PS algorithm is used as a fast recommender system which retrieves the most likely classes. Then, the actual classification is performed only considering the prototypes from the initial training set belonging to the suggested classes. Results show that this strategy provides a large set of trade-off solutions which fills the gap between PS-based classification efficiency and conventional kNN accuracy. Furthermore, this scheme is not only able to, at best, reach the performance of conventional kNN with barely a third of distances computed, but it does also outperform the latter in noisy scenarios, proving to be a much more robust approach.

Figure optionsDownload high-quality image (147 K)Download as PowerPoint slide