Examining effectiveness of tailorable computer-assisted therapy programmes for substance misuse: Programme usage and clinical outcomes data from Breaking Free Online

- Computer-assisted therapies (CAT) collect outcomes and usage data to allow examination of mechanisms of action.
- Users of the Breaking Free Online (BFO) CAT follow tailoring advice provided by the programme.
- BFO exhibits a dose response with clinical outcomes being associated with number of strategies in the programme completed.
- Mechanisms of action analyses revealed the primacy of cognitive restructuring to changes to biopsychosocial functioning.

RationaleWhen evaluating complex, tailorable digital behavioural interventions, additional approaches may be required alongside established methodologies such as randomised controlled trials (RCTs). Research evaluating a computer-assisted therapy (CAT) programme for substance misuse, Breaking Free Online (BFO), is informed by Medical Research Council (MRC) guidance recommending examination of 'mechanisms of action' of individual intervention strategies, which is relevant when evaluating digital interventions with content that may evolve over time.AimsTo report findings from examination of mechanisms of action of tailoring advice within the BFO programme and outcomes from specific intervention strategies.MethodologyAnalysis of covariance and linear regressions were used to assess intervention completion data, and psychometric and clinical outcomes, for 2311 service users accessing drug and alcohol treatment services across the UK.ResultsTailoring advice provided to users appeared to prompt them to prioritise completion of intervention strategies associated with their areas of highest biopsychosocial impairment. Completion of specific intervention strategies within BFO were associated with specific clinical outcomes, with a dose response also being found. Mechanisms of action analyses revealed the primacy of cognitions, with cognitive restructuring strategies being associated with improvements in mental health, severity of substance dependence, quality of life and global biopsychosocial functioning.ConclusionsThe MRC framework provides an evolved research paradigm within the field of digital behavioural change. By assessing baseline profiles of need, BFO can target the most appropriate clinical content for individual users. Mechanisms of action research can be used to inform modifications to BFO to continually update clinical content and the technology platform.