Decomposing response error in food consumption measurement: Implications for survey design from a randomized survey experiment in Tanzania

- This food consumption survey measurement experiment contrasts 7 common survey designs.
- We decompose response error into (a) if any consumption is reported and (b) consumption value.
- Response patterns for consumption incidence and consumption quantity markedly differ.
- Patterns of response error also significantly vary with survey design.
- We discuss implications of these findings for improved food consumption survey design.

There is wide variation in how consumption is measured in household surveys, both across countries and over time. This variation may confound welfare comparisons in part because these alternative survey designs produce consumption estimates differentially influenced by contrasting types of survey response error. While previous studies have documented the extent of net error in alternative survey designs, little is known about the relative influence of the different response errors that underpin a survey estimate. This study leverages a recent randomized food consumption survey experiment in Tanzania to shed light on the relative influence of these various error types. The observed deviation of measured household consumption from a benchmark is decomposed into item-specific consumption incidence and consumption value so as to investigate effects related to (a) the omission of any consumption and then (b) the error in value reporting conditional on positive consumption. Results show that various survey designs exhibit widely differing error decompositions and hence a simple summary comparison of the total recorded consumption across surveys will obscure specific error patterns and inhibit lessons for improved consumption survey design. In light of these findings, the relative performance of common survey designs are discussed and design lessons are drawn in order to enhance the accuracy of item-specific consumption reporting and, consequently, measures of total household food consumption.