Evidence map›Paper›PMID 41370825›Full record

ArticleJournal of medical Internet research2025

Development and Validation of an Electronic Health Record-Based Algorithm for Identifying Patients With Long-Term Opioid Therapy: Cross-Sectional Study.

Shu Huang, Tianze Jiao, Serena Jingchuan Guo, Jill A Star, Jie Xu, Jiang Bian, Debbie L Wilson, Amie J Goodin

Abstract readValidation Study
In one paragraph

Article in Journal of medical Internet research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Shu HuangDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0003-2825-9180
Tianze JiaoDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-2608-616X
Serena Jingchuan GuoDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0001-9799-2592
Jill A StarDepartment of Psychiatry, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-9732-6781
Jie XuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0001-5291-5198
Jiang BianDepartment of Biostatistics and Health Data Science, School of Medicine, Indiana University, Indianapolis, IN, United States.ORCID https://orcid.org/0000-0002-2238-5429
Debbie L WilsonShands Hospital, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-1640-5497
Amie J GoodinDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-0020-8720

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHealth care providers must carefully monitor patients receiving long-term opioid therapy (LTOT) to minimize risks and maximize benefits. Yet, algorithms to support intervention during patient encounters are lacking, with accurate LTOT identification in routine care being the essential first step.

objectiveThis study aims to develop and validate an LTOT identification algorithm using electronic health record (EHR) data.

methodsIn this cross-sectional study, we used 2016-2021 OneFlorida+ EHR data linked with Florida Medicaid claims to identify patients aged ≥18 years who received opioid prescriptions. The main outcome was the first LTOT episode in the algorithm development (2016-2018) and validation (2019-2021) periods. A Medicaid claims-based LTOT algorithm served as the reference standard, defined as ≥90 days of continuous opioid use with ≤15-day gaps. Given strong correlations among covariates, an elastic net regression model was applied to identify LTOT episodes in EHR data using patient characteristics, clinically relevant features, and medication use, and to evaluate the model's classification performance. We randomly split the 2016-2018 cohort into development and internal validation datasets (2:1 ratio), stratified by LTOT incidence. External validation was performed using 2019-2021 data.

resultsAmong 64,206 eligible patients identified in 2016-2018 (mean age 35.7, SD 12.3 years; 51,421/64,206, 80.1% female), a total of 8899 (13.9%) had LTOT. Among 50,009 eligible patients identified in 2019-2021 (mean age 37.3, SD 12.5 years; 39,866/50,009, 79.7% female), a total of 6000 (12%) had LTOT. The model selected 29 out of 131 candidate features. Among 2967 individuals with LTOT in the 2016-2018 OneFlorida+ internal validation dataset, a total of 2176 (73.3%) individuals were identified in the top 3 deciles of risk scores. The model achieved a C-statistic of 0.83 (95% CI 0.82-0.84), with 73.4% (95% CI 71.8%-75%) sensitivity, 76.8% (95% CI 76.2%-77.4%) specificity, 33.8% (95% CI 33.1%-34.6%) precision, 76.3% (95% CI 75.8%-76.9%) accuracy, and an F

conclusionsThe EHR-based LTOT algorithm showed comparable accuracy to the claims-based reference and may support risk stratification and inform decision-making during clinical encounters.

Indexed as

AlgorithmsAnalgesics, OpioidElectronic Health RecordsAdultCross-Sectional StudiesFemaleFloridaHumansMaleMedicaidMiddle AgedUnited StatesAnalgesics, Opioidchronic painclassification algorithmelectronic health recordsopioid-related disordersopioidsvalidation study

Identifiers

PMID41370825
PMCPMC12739455

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.