Estimation of an indicator of the representativeness of survey response

Nonresponse is a major source of estimation error in sample surveys. The response rate is widely used to measure survey quality associated with nonresponse, but is inadequate as an indicator because of its limited relation with nonresponse bias. Schouten et al. (2009) proposed an alternative indicator, which they refer to as an indicator of representativeness or R-indicator. This indicator measures the variability of the probabilities of response for units in the population. This paper develops methods for the estimation of this R-indicator assuming that values of a set of auxiliary variables are observed for both respondents and nonrespondents. We propose bias adjustments to the point estimator proposed by Schouten et al. (2009) and demonstrate the effectiveness of this adjustment in a simulation study where it is shown that the method is valid, especially for smaller sample sizes. We also propose linearization variance estimators which avoid the need for computer-intensive replication methods and show good coverage in the simulation study even when models are not fully specified. The use of the proposed procedures is also illustrated in an application to two business surveys at Statistics Netherlands.

► An indicator of representativeness of response in surveys or R-indicator was proposed in Schouten et al. (2009).
► The indicator measures the variability of the probabilities of response for units in the population.
► We propose bias adjustments to the point estimator and demonstrate the effectiveness of this adjustment in a simulation.
► The use of the proposed procedures is illustrated in an application to two business surveys at Statistics Netherlands.
► We propose linearization variance estimators which shows good coverage in the simulation.