A randomized controlled study of a web-based performance improvement system for substance abuse treatment providers

We report here the results of a randomized, controlled trial evaluating the efficacy of a semiautomated performance improvement system (“patient feedback”) that enables real-time monitoring of patient outcomes in outpatient substance abuse treatment clinics. The study involved 118 clinicians working at 20 community-based outpatient substance abuse treatment clinics in the northeast United States. Ten clinics received 12 weeks of the patient feedback performance improvement intervention, and 10 clinics received no intervention during the 12 weeks. More than 1,500 patients provided anonymous ratings of therapeutic alliance, treatment satisfaction, and drug/alcohol use. There was no evidence of an intervention effect on the primary drug and alcohol use scales. There was also no evidence of an intervention effect on secondary measures of therapeutic alliance. Clinician-rated measures of organizational functioning and job satisfaction also showed no intervention effect. Possible insights from these findings and alternative methods of utilizing feedback reports to enhance clinical outcomes are proposed.