Measurement of constructs using self-report and behavioral lab tasks: Is there overlap in nomothetic span and construct representation for impulsivity?

There has been little empirical evidence examining the overlap in nomothetic span for self-report measures and construct representation for behavioral lab tasks in most psychological constructs. Using the personality trait of impulsivity as an example, the authors completed a meta-analysis of 27 published research studies examining the relationship between these methods. In general, although there is a statistically significant relationship between multidimensional self-report and lab task impulsivity (r = 0.097), practically, the relationship is small. Examining relationships among unidimensional impulsivity self-report and lab task conceptualizations indicated very little overlap in self-report and behavioral lab task constructs. Significant relationships were found between lack of perseverance and prepotent response inhibition (r = 0.099); between lack of planning and prepotent response inhibition (r = 0.106), delay response (r = 0.134), and distortions in elapsed time (r = 0.104); between negative urgency and prepotent response inhibition (r = 0.106); and between sensation seeking and delay response (r = 0.131). Researchers should take care to specify which particular unidimensional constructs are operationalized with not only impulsivity, but with all traits. If self-report and lab task conceptualizations measure disparate aspects of impulsivity, we, as a field, should not expect large conceptual overlap between these methods.

► We review the relationship between self-report and behavioral measures of psychological constructs.
► We complete a meta-analysis of 28 published studies of this relationship for the construct of impulsivity.
► There is little but some significant overlap between self-report and lab task impulsivity.
► Self-report and lab task impulsivity seem to be measuring different underlying constructs.
► It is important to specify unidimensional discrete constructs in research for scientific advancement.