Using confidence ratings to identify a target among foils

Sauer, Brewer, and Weber (2008) advanced a novel procedure for testing eyewitness recognition memory. Rather than providing a single decision (i.e., identifying a lineup member or rejecting the lineup as a whole), participants rated their confidence that each lineup member was the culprit. Classification algorithms determined when patterns of confidence ratings indicated suspect guilt or innocence. Across varied test stimuli, confidence-based classifications equalled or out-performed single decisions. However, Sauer et al.’s classification criteria were designed to optimize performance for the data to which they were applied. If effective classification using confidence ratings requires such idiosyncratic criteria, the applied utility of the confidence procedure is nil. We re-analysed the data from Sauer et al.’s two identification experiments and demonstrated that confidence-based classification performance exceeding that of a traditional lineup task did not depend on uniquely developed classification criteria. Confidence-rating lineups offer a potentially promising alternative to procedures requiring single decisions from witnesses.

► Sauer, Brewer, and Weber (2008) advanced a novel procedure for testing eyewitness recognition memory.
► Participants rated their confidence that each lineup member was the culprit, rather than providing a single decision.
► Algorithms determined when patterns of confidence ratings indicated suspect guilt or innocence.
► We tested if effective classification performance depended on applying idiosyncratic classification criteria.
► Stable classification performance did not depend on uniquely developed classification criteria.