Evidence map›Paper›PMID 38065778›Full record

ArticleThe Lancet. Digital health2024

Electrocardiographic deep learning for predicting post-procedural mortality: a model development and validation study.

David Ouyang, John Theurer, Nathan R Stein, J Weston Hughes, Pierre Elias, Bryan He, Neal Yuan, Grant Duffy, Roopinder K Sandhu, Joseph Ebinger and 14 more

Open access · goldAbstract read
In one paragraph

Article in The Lancet. Digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 2 pooled it
11.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 2 syntheses or guidelines pooled it, 54 citations in OpenAlex.

  1. Guideline
  2. Machine learning for endoscopic third ventriculostomy success prediction-a systematic review and meta-analysis.Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery · 2025
    Pooled it
  3. Article
  4. Article
  5. Observational
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Observational
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

24 authors at 6 institutions in 1 country.

David OuyangDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA; Division of Artificial Intelligence in Medicine, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA. Electronic address: david.ouyang@cshs.org.
John TheurerDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Nathan R SteinDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
J Weston HughesDepartment of Computer Science, Stanford University, Palo Alto, CA, USA.
Pierre EliasMilstein Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center, New York, NY, USA; Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY, USA.
Bryan HeDepartment of Computer Science, Stanford University, Palo Alto, CA, USA.
Neal YuanDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Grant DuffyDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Roopinder K SandhuDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Joseph EbingerDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Patrick BottingDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Melvin JujjavarapuDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Brian ClaggettDivision of Cardiovascular Medicine, Department of Medicine, Brigham and Women's Hospital, Boston, MA, USA.
James E TooleyDivision of Cardiology, Stanford University, Palo Alto, CA, USA.
Tim PoteruchaMilstein Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center, New York, NY, USA.
Jonathan H ChenDivision of Bioinformatics Research, Stanford University, Palo Alto, CA, USA.
Michael NurokDivision of Anesthesia, Department of Surgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Marco PerezDivision of Cardiology, Stanford University, Palo Alto, CA, USA.
Adler PerotteMilstein Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center, New York, NY, USA.
James Y ZouDepartment of Computer Science, Stanford University, Palo Alto, CA, USA; Department of Medicine, and Department of Biomedical Data Science, Stanford University, Palo Alto, CA, USA.
Nancy R CookDivision of Preventive Medicine, Department of Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Sumeet S ChughDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA; Division of Artificial Intelligence in Medicine, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Susan ChengDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Christine M AlbertDepartment of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
Cedars-Sinai Medical Center · USCedars-Sinai Smidt Heart Institute · USColumbia University Irving Medical Center · USPalo Alto University · USStanford University · USBrigham and Women's Hospital · US

Funding

Western States Node of the National Drug Abuse Treatment Clinical Trials Network (TMS for CUD) UG1DA015815 · NIDA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Keith N. Humphreys, Philip Todd Korthuis · 2015 to 2026
$24.6M
POSTDOCTORAL TRAINING IN CARDIOVASCULAR DISEASET32HL007854 · NHLBI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Marwah Abdalla, Michael Argenziano · 1996 to 2026
$14.7M
PRE-DETERMINE: Advancing Sudden Arrhythmic Death Prediction in Coronary Artery Disease in the Absence of Severe Systolic DysfunctionR01HL165840 · NHLBI · CEDARS-SINAI MEDICAL CENTER · PI CHRISTINE M ALBERT, Susan Cheng · 2023 to 2026
$6.0M
The WHI Strong and Healthy SilenT Atrial fibrillation Recording study (WHISH STAR)R01HL136390 · NHLBI · STANFORD UNIVERSITY · PI PEREZ, MARCO V · 2017 to 2021
$3.6M
Measuring and Predicting Appropriate Antibiotic Use to Combat Resistant BacteriaR01AI178121 · NIAID · STANFORD UNIVERSITY · PI JONATHAN H. CHEN · 2023 to 2026
$3.1M
Deep Learning Assessment of the Right Ventricle: Function, Etiology, and PrognosisR00HL157421 · NHLBI · KAISER FOUNDATION RESEARCH INSTITUTE · PI OUYANG, DAVID · 2023 to 2025
$747k
Machine Learning Clinical Order Recommendations for Specialty Consultation CareR56LM013365 · NLM · STANFORD UNIVERSITY · PI CHEN, JONATHAN H. · 2020 to 2020
$394k
Deep Learning Assessment of the Right Ventricle: Function, Etiology, and PrognosisK99HL157421 · NHLBI · CEDARS-SINAI MEDICAL CENTER · PI OUYANG, DAVID · 2021 to 2022
$313k
NHLBI NIH HHS K99 HL157421NHLBI NIH HHS R00 HL157421NHLBI NIH HHS R01 HL136390NHLBI NIH HHS R01 HL165840NHLBI NIH HHS T32 HL007854NIAID NIH HHS R01 AI178121NIDA NIH HHS UG1 DA015815NLM NIH HHS R56 LM013365
6 · The paper itself

Abstract

backgroundPreoperative risk assessments used in clinical practice are insufficient in their ability to identify risk for postoperative mortality. Deep-learning analysis of electrocardiography can identify hidden risk markers that can help to prognosticate postoperative mortality. We aimed to develop a prognostic model that accurately predicts postoperative mortality in patients undergoing medical procedures and who had received preoperative electrocardiographic diagnostic testing.

methodsIn a derivation cohort of preoperative patients with available electrocardiograms (ECGs) from Cedars-Sinai Medical Center (Los Angeles, CA, USA) between Jan 1, 2015 and Dec 31, 2019, a deep-learning algorithm was developed to leverage waveform signals to discriminate postoperative mortality. We randomly split patients (8:1:1) into subsets for training, internal validation, and final algorithm test analyses. Model performance was assessed using area under the receiver operating characteristic curve (AUC) values in the hold-out test dataset and in two external hospital cohorts and compared with the established Revised Cardiac Risk Index (RCRI) score. The primary outcome was post-procedural mortality across three health-care systems.

findings45 969 patients had a complete ECG waveform image available for at least one 12-lead ECG performed within the 30 days before the procedure date (59 975 inpatient procedures and 112 794 ECGs): 36 839 patients in the training dataset, 4549 in the internal validation dataset, and 4581 in the internal test dataset. In the held-out internal test cohort, the algorithm discriminates mortality with an AUC value of 0·83 (95% CI 0·79-0·87), surpassing the discrimination of the RCRI score with an AUC of 0·67 (0·61-0·72). The algorithm similarly discriminated risk for mortality in two independent US health-care systems, with AUCs of 0·79 (0·75-0·83) and 0·75 (0·74-0·76), respectively. Patients determined to be high risk by the deep-learning model had an unadjusted odds ratio (OR) of 8·83 (5·57-13·20) for postoperative mortality compared with an unadjusted OR of 2·08 (0·77-3·50) for postoperative mortality for RCRI scores of more than 2. The deep-learning algorithm performed similarly for patients undergoing cardiac surgery (AUC 0·85 [0·77-0·92]), non-cardiac surgery (AUC 0·83 [0·79-0·88]), and catheterisation or endoscopy suite procedures (AUC 0·76 [0·72-0·81]).

interpretationA deep-learning algorithm interpreting preoperative ECGs can improve discrimination of postoperative mortality. The deep-learning algorithm worked equally well for risk stratification of cardiac surgeries, non-cardiac surgeries, and catheterisation laboratory procedures, and was validated in three independent health-care systems. This algorithm can provide additional information to clinicians making the decision to perform medical procedures and stratify the risk of future complications.

fundingNational Heart, Lung, and Blood Institute.

Indexed as

Deep LearningAlgorithmsElectrocardiographyHumansPrognosisRisk Assessment

Identifiers

PMID38065778
PMCPMC13184298
OpenAlexW4389425951

What Socratic holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.