Masking effects on linear regression in multi-class classification

The linear regression method belongs to the important class of linear methods for multi-class classification. Empirical evidences suggest that a masking problem occurs with the linear regression approach and it is especially prevalent when the number of classes is large. This paper provides an analytical study of this issue and explicitly explains why the linear discriminant analysis procedure removes this problem.