Clear-sky irradiance predictions for solar resource mapping and large-scale applications: Improved validation methodology and detailed performance analysis of 18 broadband radiative models

The intrinsic performance of 18 broadband radiative models is assessed, using high-quality datasets from five sites in widely different climates. The selected models can predict direct, diffuse and global irradiances under clear skies from atmospheric data, and have all been (or still are) involved in large-scale applications, for instance to prepare solar resource maps and datasets, or to evaluate solar radiation in GIS software. The input data to the models include accurate aerosol and water vapor measurements by collocated sunphotometers, if needed. Cloud occurrences are meticulously scrutinized through the use of various tools to avoid cloud contamination of the test data. The intrinsic performance of the models is evaluated by comparison between their predictions and measurements at high frequency (1-minute time step at four sites, 3-minute at one site). The total expanded uncertainty of these measurements is estimated at 3% for direct irradiance, and 5% for diffuse and global irradiance.Various statistics are calculated to evaluate the systematic and random differences between the data series, as well as the agreement between the cumulative distribution functions. In the latter case, stringent statistics based on the Komolgorov–Smirnov (KS) test are used. Large differences in performance are apparent between models. Those that require more atmospheric inputs perform usually better than simpler models. Whereas many models can predict the global horizontal irradiance within uncertainty limits similar to those of the radiation measurements, the prediction of direct irradiance is less accurate. Moreover, the prediction of diffuse horizontal irradiance is particularly deficient in most models. The cumulative distribution functions also denote areas of concern.A ranking of all models is proposed, based on four statistical indicators: mean bias difference (MBD), root mean square difference (RMSD), total uncertainty with 95% confidence limits (U95), and the newly introduced Combined Performance Index (CPI), which optimally combines two KS indices with RMSD. For direct irradiance, consistently high rankings are obtained with five models (REST2, Ineichen, Hoyt, Bird, and Iqbal-C, in decreasing order of performance) that require a relatively large number of atmospheric inputs. The inferior performance of models requiring little or no atmospheric inputs suggests that large-scale solar resource products derived from them may be inappropriate for serious solar applications. Additionally, prediction uncertainties under ideal clear-sky conditions can propagate and affect all-sky predictions as well—resulting in potential biases in existing solar resource maps at the continent scale, for instance.

► Performance of 18 radiative models is examined using radiation data from five sites. ► Models require up to eight atmospheric inputs, obtained from collocated instruments. ► Good performance of many models for global irradiance, poor performance for diffuse. ► Normalized cumulative distribution functions for direct irradiance are tested. ► Model ranking based on MBD, RMSD and new combined performance index.