کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
532420 | 869947 | 2012 | 10 صفحه PDF | دانلود رایگان |
In the literature, there exist statistical tests to compare supervised learning algorithms on multiple data sets in terms of accuracy but they do not always generate an ordering. We propose Multi2Test, a generalization of our previous work, for ordering multiple learning algorithms on multiple data sets from “best” to “worst” where our goodness measure is composed of a prior cost term additional to generalization error. Our simulations show that Multi2Test generates orderings using pairwise tests on error and different types of cost using time and space complexity of the learning algorithms.
► Proposes a statistical methodology to find the best of or order multiple classification algorithms over multiple data sets.
► Uses space or time complexity as cost measure for tie-breaking in case of equal error.
► Can be generalized to other settings, e.g., regression.
Journal: Pattern Recognition - Volume 45, Issue 4, April 2012, Pages 1772–1781