Evidence map›Paper›PMID 40316004›Full record

ArticleJournal of biomedical informatics2025

Leveraging undecided cases in chart-reviewed phenotypes to enhance EHR-based association studies.

Xinyao Jian, Dazheng Zhang, Zehao Yu, Hua Xu, Jiang Bian, Yonghui Wu, Jiayi Tong, Yong Chen

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Xinyao JianThe Center for Health Analytics and Synthesis of Evidence (CHASE), University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, PA, USA.
Dazheng ZhangThe Center for Health Analytics and Synthesis of Evidence (CHASE), University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, PA, USA.
Zehao YuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, USA.
Hua XuDepartment of Biomedical Informatics and Data Science, School of Medicine, Yale University, New Haven, CT, USA.
Jiang BianDepartment of Biostatistics and Health Data Science, School of Medicine, Indiana University, Indianapolis, IN, USA; Regenstreif Institute, Indianapolis, Indiana, IN, USA.
Yonghui WuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, USA; Cancer Informatics Shared Resource, University of Florida Health Cancer Center, Gainesville, FL, USA.
Jiayi TongThe Center for Health Analytics and Synthesis of Evidence (CHASE), University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, PA, USA; Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
Yong ChenThe Center for Health Analytics and Synthesis of Evidence (CHASE), University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, PA, USA; The Graduate Group in Applied Mathematics and Computational Science, School of Arts and Sciences, University of Pennsylvania, Philadelphia, PA, USA; Leonard Davis Institute of Health Economics, Philadelphia, PA, USA; Penn Medicine Center for Evidence-based Practice (CEP), Philadelphia, PA, USA; Penn Institute for Biomedical Informatics (IBI), Philadelphia, PA, USA. Electronic address: ychen123@upenn.edu.

Funding

Coordinating Individually Measured Phenotypes to Advance Mental Health ResearchU24MH136069 · NIMH · YALE UNIVERSITY · PI Yong Chen, Cui Tao · 2024 to 2026
$9.8M
PANDA-MSD: Predictive Analytics via Networked Distributed Algorithms for Multi-System DiseasesU01TR003709 · NCATS · UNIVERSITY OF PENNSYLVANIA · PI BIAN, JIANG, CHEN, YONG · 2022 to 2025
$4.7M
ACTS (AD Clinical Trial Simulation): Developing Advanced Informatics Approaches for an Alzheimer's Disease Clinical Trial Simulation SystemR01AG084236 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI Jiang Bian, Cui Tao · 2023 to 2026
$4.1M
TRiPOD: Toward Reusable Phenotypes in Observational Data for AD/ADRD - managing definitions and correcting biasR01AG073435 · NIA · UNIVERSITY OF PENNSYLVANIA · PI CHEN, YONG, XU, HUA · 2021 to 2025
$3.9M
Computational Drug Repurposing for AD/ADRD with Integrative Analysis of Real World Data and Biomedical KnowledgeR01AG076234 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Jiang Bian, Fei Wang · 2022 to 2026
$3.8M
Dynamic learning for post-vaccine event prediction using temporal information in VAERSR01AI130460 · NIAID · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI CHEN, YONG, TAO, CUI · 2017 to 2021
$3.4M
Eligibility criteria design for Alzheimer's trials with real-world data and explainable AIR01AG080991 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Jiang Bian, Fei Wang · 2023 to 2026
$3.1M
Disparities of Alzheimer's disease progression in Sexual Minority IndividualsR01AG080624 · NIA · UNIVERSITY OF FLORIDA · PI Jiang Bian, Yi Guo · 2023 to 2026
$3.1M
Artificial Intelligence and Counterfactually Actionable Responses to End HIV (AI-CARE-HIV)R01AI172875 · NIAID · UNIVERSITY OF FLORIDA · PI Jiang Bian, Mattia Prosperi · 2023 to 2026
$2.8M
ClinEX - Clinical Evidence Extraction, Representation, and AppraisalR01LM014344 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Yong Chen, Yifan Peng · 2023 to 2026
$2.7M
AI-ADRD: Accelerating interventions of AD/ADRD via Machine learning methodsRF1AG077820 · NIA · UNIVERSITY OF PENNSYLVANIA · PI BIAN, JIANG, CHEN, YONG · 2023 to 2023
$2.3M
PheBC: bias correction methods for EHR derived phenotypeR01LM013519 · NLM · UNIVERSITY OF PENNSYLVANIA · PI CHEN, YONG, XU, HUA · 2021 to 2024
$1.6M
NCATS NIH HHS U01 TR003709NEI NIH HHS R21 EY034179NIAID NIH HHS R01 AI130460NIAID NIH HHS R01 AI172875NIAID NIH HHS R21 AI167418NIA NIH HHS R01 AG073435NIA NIH HHS R01 AG076234NIA NIH HHS R01 AG080624NIA NIH HHS R01 AG080991NIA NIH HHS R01 AG084236NIA NIH HHS R56 AG069880NIA NIH HHS R56 AG074604NIA NIH HHS RF1 AG077820NIMH NIH HHS U24 MH136069NLM NIH HHS R01 LM012607NLM NIH HHS R01 LM013519NLM NIH HHS R01 LM014344
6 · The paper itself

Abstract

objectivesIn electronic health record (EHR)-based association studies, phenotyping algorithms efficiently classify patient clinical outcomes into binary categories but are susceptible to misclassification errors. The gold standard, manual chart review, involves clinicians determining the true disease status based on their assessment of health records. These clinicians-labeled phenotypes are labor-intensive and typically limited to a small subset of patients, potentially introducing a third "undecided" category when phenotypes are indeterminate. We aim to effectively integrate the algorithm-derived and chart-reviewed outcomes when both are available in EHR-based association studies. MATERIAL AND

methodsWe propose an augmented estimation method that combines the binary algorithm-derived phenotypes for the entire cohort with the trinary chart-reviewed phenotypes for a small, selected subset. Additionally, a cost-effective outcome-dependent sampling strategy is used to address the rare disease scenarios. The proposed trinary chart-reviewed phenotype integrated cost-effective augmented estimation (TriCA) was evaluated across a wide range of simulation settings and real-world applications, including using EHR data on Alzheimer's disease and related dementias (ADRD) from the OneFlorida + Clinical Research Network, and using cohort data on second breast cancer events (SBCE) from the Kaiser Permanente Washington.

resultsCompared to estimation based on random sampling, our augmented method improved mean square error by up to 28.3% in simulation studies; compared to estimation using only trinary chart-reviewed phenotypes, our method improved efficiency by up to 33.3% in ADRD data and 50.8% in SBCE data. DISCUSSION: Our simulation studies and real-world applications demonstrate that, compared to existing methods, the proposed method provides unbiased estimates with higher statistical efficiency.

conclusionThe proposed method effectively combined binary algorithm-derived phenotypes for the whole cohort with trinary chart-reviewed outcomes for a limited validation set, making it applicable to a broader range of applications and enhancing risk factor identification in EHR-based association studies.

Indexed as

Electronic Health RecordsPhenotypeAlgorithmsAlzheimer DiseaseFemaleHumansAssociation studyAugmented estimationElectronic health recordsManual chart reviewOutcome-dependent samplingPhenotyping error

Identifiers

PMID40316004
PMCPMC12243065

What Socratic holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.