کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
530707 | 869784 | 2012 | 11 صفحه PDF | دانلود رایگان |
We categorize the statistical assessment of classifiers into three levels: assessing the classification performance and its testing variability conditional on a fixed training set, assessing the performance and its variability that accounts for both training and testing, and assessing the performance averaging over training sets and its variability that accounts for both training and testing. We derived analytical expressions for the variance of the estimated AUC and provide freely available software implemented with an efficient computation algorithm. Our approach can be applied to assess any classifier that has ordinal (continuous or discrete) outputs. Applications to simulated and real datasets are presented to illustrate our methods.
► A unified three-level framework for the assessment of classifier performance.
► Analytical expressions for the variance of AUC accounting for both training and testing.
► Freely available software implemented with an efficient computation algorithm.
Journal: Pattern Recognition - Volume 45, Issue 7, July 2012, Pages 2661–2671