Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research

The aim of this study was to investigate the psychometric properties of Internet administered questionnaires used in panic research. Included were 494 people who had registered for an Internet-based treatment program for panic disorder (PD). Participants were randomly assigned to fill in the questionnaires either on the Internet or the paper-and-pencil versions, and then to fill in the same questionnaires again the next day using the other format. The questionnaires were the body sensations questionnaire [BSQ; Chambless, D. L., Caputo, G. C., Bright, P., & Gallagher, R. (1984). Assessment of fear of fear in agoraphobics: the body sensations questionnaire and the agoraphobic cognitions questionnaire. Journal of Consulting and Clinical Psychology, 52, 1090–1097], agoraphobic cognitions questionnaire [ACQ; Chambless, D. L., Caputo, G. C., Bright, P., & Gallagher, R. (1984). Assessment of fear of fear in agoraphobics: the body sensations questionnaire and the agoraphobic cognitions questionnaire. Journal of Consulting and Clinical Psychology, 52, 1090–1097], mobility inventory [MI; Chambless, D. L., Caputo, G., Jasin, S., Gracely, E. J., & Williams, C. (1985). The mobility inventory for agoraphobia. Behaviour Research and Therapy, 23, 35–44], beck anxiety inventory [BAI; Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: psychometric properties. Journal of Consulting and Clinical Psychology, 56, 893–897], beck depression inventory II [Beck, A. T., & Steer, R. A. (1996). Beck Depression Inventory. Manual, Svensk version (Swedish version). Fagernes, Norway: Psykologiförlaget, AB], quality of life inventory [QOLI; Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992). Clinical validation of the quality of life inventory. A measure of life satisfaction for use in treatment planning and outcome assessment. Psychological Assessment, 4, 92–101], and montgomery Åsberg depression rating scale [MADRS; Svanborg, P., & Åsberg, M. (1994). A new self-rating scale for depression and anxiety states based on the comprehensive psychopathological rating scale. ACTA Psychiatrica Scandinavica, 89, 21–28]. Results showed largely equivalent psychometric properties for the two administration formats (Cronbach’s α between 0.79 and 0.95). The results also showed high and significant correlations between the Internet and the paper-and-pencil versions. Analyses of order effects showed an interaction effect for the BSQ and the MI (subscale Accompanied), a main effect was identified for ACQ, MI-Alone, BAI and BDI II. However, in contrast to previous research, the Internet version did not consistently generate higher scores and effect sizes for the differences were generally low. Given the presence of an interaction effect, we recommend that the administration format should be stable in research across measurement points. Finally, the findings suggest that Internet versions of questionnaires used in PD research can be used with confidence.