Context effects and the temporal stability of stated preferences

•We experimentally vary the question order in a stated preference survey on ethical consumption.•The ethical product includes Peace Products jointly produced by Israeli and Palestinians.•Placing questions on anti-Semitism and anti-Arabism before the choice experiment causes preference changes.•This directional context effect is replicated in a second survey 10 month after the first survey.•Comparing the first and second surveys, we find that stated preferences are temporally stable.

In stated preference studies it is assumed that individuals' answers reflect true preferences and are stable over time. We test these two assumptions of validity and reliability using as an example a choice experiment study on ethical consumption that measures preferences for a Peace Product jointly produced by Israeli and Palestinian producers as well as for organic products. In a web survey conducted in Germany, we investigate the validity assumption by manipulating the question context and presenting one group of respondents with questions on anti-Semitic and anti-Arabic attitudes before the choice tasks, and presenting another group with these questions after the choice tasks. In order to test the assumption of temporal stability, the same experimental set-up was repeated in a second survey based on a new sample ten months after the first. However, prior to the second survey an external event, a major violent dispute between Israelis and the Palestinians occurred. Overall, we find evidence for a context effect but not for temporal instability. In both surveys, the placement of the attitudinal questions before the choice tasks has a positive effect on the valuation of products from Israel, Palestinian products and the Peace Product (i.e. a directional context effect). The respondents seem to act according to an anti-discrimination norm. In line with this reasoning, we find an attention shift caused by the attitudinal questions. Organic products are valued much less positively if discriminatory attitudes are surveyed before the choice tasks. Furthermore, despite the violent dispute, stated preferences are very stable over time. This indicates high reliability of stated preference studies and encourages the use of study results by private and public decision makers.