In-sample vs. out-of-sample tests of stock return predictability in the context of data mining

We undertake an extensive analysis of in-sample and out-of-sample tests of stock return predictability in an effort to better understand the nature of the empirical evidence on return predictability. We find that a number of financial variables appearing in the literature display both in-sample and out-of-sample predictive ability with respect to stock returns in annual data covering most of the twentieth century. In contrast to the extant literature, we demonstrate that there is little discrepancy between in-sample and out-of-sample test results once we employ out-of-sample tests with good power. While conventional wisdom holds that out-of-sample tests help guard against data mining, Inoue and Kilian [Inoue, A., Kilian, L., 2004. In-sample or out-of-sample tests of predictability: which one should we use? Econometric Reviews 23, 371–402.] recently argue that in-sample and out-of-sample tests are equally susceptible to data mining biases. Using a bootstrap procedure that explicitly accounts for data mining, we still find that certain financial variables display significant in-sample and out-of-sample predictive ability with respect to stock returns.