Evaluation of land-use regression models used to predict air quality concentrations in an urban area

Cohort studies designed to estimate human health effects of exposures to urban pollutants require accurate determination of ambient concentrations in order to minimize exposure misclassification errors. However, it is often difficult to collect concentration information at each study subject location. In the absence of complete subject-specific measurements, land-use regression (LUR) models have frequently been used for estimating individual levels of exposures to ambient air pollution. The LUR models, however, have several limitations mainly dealing with extensive monitoring data needs and challenges involved in their broader applicability to other locations. In contrast, air quality models can provide high-resolution source–concentration linkages for multiple pollutants, but require detailed emissions and meteorological information. In this study, first we predicted air quality concentrations of PM2.5, NOx, and benzene in New Haven, CT using hybrid modeling techniques based on CMAQ and AERMOD model results. Next, we used these values as pseudo-observations to develop and evaluate the different LUR models built using alternative numbers of (training) sites (ranging from 25 to 285 locations out of the total 318 receptors). We then evaluated the fitted LUR models using various approaches, including: 1) internal “Leave-One-Out-Cross-Validation” (LOOCV) procedure within the “training” sites selected; and 2) “Hold-Out” evaluation procedure, where we set aside 33–293 tests sites as independent datasets for external model evaluation. LUR models appeared to perform well in the training datasets. However, when these LUR models were tested against independent hold out (test) datasets, their performance diminished considerably. Our results confirm the challenges facing the LUR community in attempting to fit empirical response surfaces to spatially- and temporally-varying pollution levels using LUR techniques that are site dependent. These results also illustrate the potential benefits of enhancing basic LUR models by utilizing air quality modeling tools or concepts in order to improve their reliability or transferability.