Measuring the quality of substance use disorder treatment: Evaluating the validity of the Department of Veterans Affairs continuity of care performance measure

This study examined the patient- and facility-level associations between the continuity of care performance measure adopted by the Department of Veterans Affairs (VA) and improvements in self-administered Addiction Severity Index (ASI) composites and other indicators of problematic substance use. Up to 50 patients from each of a nationally representative sample of 109 VA substance use disorder (SUD) treatment programs at 73 VA facilities were assessed at intake and posttreatment. The continuity of care performance measure specifies that patients should receive at least two SUD outpatient visits in each of the three consecutive 30-day periods after they qualify as new SUD patients. In analyses adjusting for baseline characteristics, meeting the continuity of care performance measure was not associated with patient-level improvements in the ASI alcohol or drug composites, days of alcohol intoxication, or days of substance-related problems. Facility-level rates of continuity of care were negatively associated with improvements in ASI alcohol and drug composites. The continuity of care performance measure derived from prior patient-level evidence did not discriminate facility-level performance as predicted. Translating research into process-of-care quality measures requires postconstruction validation.