Article ID | Journal | Published Year | Pages | File Type |
---|---|---|---|---|
9732528 | International Journal of Forecasting | 2005 | 13 Pages |
Abstract
The main conclusions of the M3 competition were derived from the analyses of descriptive statistics with no formal statistical testing. One of the commentaries noted that the results had not been tested for statistical significance. This paper undertakes such an analysis by examining the primary findings of that competition. We introduce a new methodology that has not previously been used to evaluate economic forecasts: multiple comparisons. We use this technique to compare each method against the best and against the mean. We conclude that the accuracy of the various methods does differ significantly, and that some methods are significantly better than others. We confirm that there is no relationship between complexity and accuracy but also show that there is a significant relationship among the various measures of accuracy. Finally, we find that the M3 conclusion that a combination of methods is better than that of the methods being combined was not proven.
Related Topics
Social Sciences and Humanities
Business, Management and Accounting
Business and International Management
Authors
Alex J. Koning, Philip Hans Franses, Michèle Hibon, H.O. Stekler,