Automated Prediction of Risk for Problem Opioid Use in a Primary Care Setting

• An automated method predictive in identifying clinician-documented problem opioid use was assessed.
• Analysis developed measures using information from a health plan's electronic health record system.
• Models showed moderate sensitivity and specificity in predicting problem opioid use.
• The method may enable more efficient implementation of problem opioid use detection.

Identification of patients at increased risk for problem opioid use is recommended by chronic opioid therapy (COT) guidelines, but clinical assessment of risks often does not occur on a timely basis. This research assessed whether structured electronic health record (EHR) data could accurately predict subsequent problem opioid use. This research was conducted among 2,752 chronic noncancer pain patients initiating COT (≥70 days' supply of an opioid in a calendar quarter) during 2008 to 2010. Patients were followed through the end of 2012 or until disenrollment from the health plan, whichever was earlier. Baseline risk indicators were derived from structured EHR data for a 2-year period prior to COT initiation. Problem opioid use after COT initiation was assessed by reviewing clinician-documented problem opioid use in EHR clinical notes identified using natural language processing techniques followed by computer-assisted manual review of natural language processing–positive clinical notes. Multivariate analyses in learning and validation samples assessed prediction of subsequent problem opioid use. The area under the receiver operating characteristic curve (c-statistic) for problem opioid use was .739 (95% confidence interval = .688, .790) in the validation sample. A measure of problem opioid use derived from a simple weighted count of risk indicators was found to be comparably predictive of the natural language processing measure of problem opioid use, with 60% sensitivity and 72% specificity for a weighted count of ≥4 risk indicators.PerspectiveAn automated surveillance method utilizing baseline risk indicators from structured EHR data was moderately accurate in identifying COT patients who had subsequent problem opioid use.