Evaluating energy behavior change programs using randomized controlled trials: Best practice guidelines for policymakers

Governments and policymakers around the globe are becoming increasingly interested in how to effectively change the behavior of energy consumers. In the residential sector, numerous programs are attempting to shift the behavior of individuals and households in the public interest-for example toward more energy efficient practices, greater uptake of demand-side management technology, increased use of renewable energy, and better responsiveness to new tariffs (e.g., dynamic pricing), to name but a few. However, the effectiveness of such behavior change interventions is often limited, or even unknown, due to weaknesses in program design and evaluation of program impact on behavior. To help policymakers avoid such pitfalls, this paper outlines some practical guidelines for designing, conducting and, most importantly, evaluating the impact of energy-related behavior change programs and initiatives. We explain why randomized controlled trials are generally the optimal approach for obtaining scientifically valid estimates of a behavioral program's efficacy and effectiveness. In parallel, we offer specific guidelines for strengthening the validity, reliability and generalizability of empirical findings about program impact on behavior. Adopting these guidelines will help to improve program design and delivery, thereby allowing more accurate evaluation of the true cost-effectiveness, utility and mass-scalability of future energy-related behavioral interventions.