Evidence map›Paper›PMID 38036723›Full record

ArticleNPJ digital medicine2023

Zero-shot interpretable phenotyping of postpartum hemorrhage using large language models.

Emily Alsentzer, Matthew J Rasmussen, Romy Fontoura, Alexis L Cull, Brett Beaulieu-Jones, Kathryn J Gray, David W Bates, Vesela P Kovacheva

Open access · goldAbstract read
In one paragraph

Article in NPJ digital medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed
34.8field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 60 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Emily AlsentzerDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.ORCID http://orcid.org/0000-0002-5370-1746
Matthew J RasmussenDepartment of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Romy FontouraDepartment of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Alexis L CullDepartment of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Brett Beaulieu-JonesSection of Biomedical Data Science, Department of Medicine, University of Chicago, Chicago, IL, USA.
Kathryn J GrayCenter for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA.ORCID http://orcid.org/0000-0002-3541-3724
David W BatesDivision of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.ORCID http://orcid.org/0000-0001-6268-1540
Vesela P KovachevaDepartment of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA. vkovacheva@bwh.harvard.edu.ORCID http://orcid.org/0000-0001-7367-3394
Brigham and Women's Hospital · USUniversity of Chicago · US

Funding

Signatures of dysfunctional mitochondrial fatty acid oxidation that predispose to early-onset preeclampsiaK08HL146963 · NHLBI · MASSACHUSETTS GENERAL HOSPITAL · PI GRAY, KATHRYN JOHNSON · 2019 to 2023
$940k
Personalized Postpartum Hemorrhage Prediction Using Machine Learning And Polygenic Risk ScoresK08HL161326 · NHLBI · BRIGHAM AND WOMEN'S HOSPITAL · PI Vesela Kovacheva · 2022 to 2026
$842k
Characterizing Population Differences between Clinical Trial and Real World PopulationsR00NS114850 · NINDS · UNIVERSITY OF CHICAGO · PI BEAULIEU-JONES, BRETT K · 2023 to 2025
$740k
Clinical and functional follow-up of maternal and fetal preeclampsia genetic risk lociR03HL162756 · NHLBI · UNIVERSITY OF WASHINGTON · PI GRAY, KATHRYN JOHNSON · 2022 to 2023
$168k
NHLBI NIH HHS K08 HL146963NHLBI NIH HHS K08 HL161326NHLBI NIH HHS R03 HL162756NINDS NIH HHS R00 NS114850
6 · The paper itself

Abstract

Many areas of medicine would benefit from deeper, more accurate phenotyping, but there are limited approaches for phenotyping using clinical notes without substantial annotated data. Large language models (LLMs) have demonstrated immense potential to adapt to novel tasks with no additional training by specifying task-specific instructions. Here we report the performance of a publicly available LLM, Flan-T5, in phenotyping patients with postpartum hemorrhage (PPH) using discharge notes from electronic health records (n = 271,081). The language model achieves strong performance in extracting 24 granular concepts associated with PPH. Identifying these granular concepts accurately allows the development of interpretable, complex phenotypes and subtypes. The Flan-T5 model achieves high fidelity in phenotyping PPH (positive predictive value of 0.95), identifying 47% more patients with this complication compared to the current standard of using claims codes. This LLM pipeline can be used reliably for subtyping PPH and outperforms a claims-based approach on the three most common PPH subtypes associated with uterine atony, abnormal placentation, and obstetric trauma. The advantage of this approach to subtyping is its interpretability, as each concept contributing to the subtype determination can be evaluated. Moreover, as definitions may change over time due to new guidelines, using granular concepts to create complex phenotypes enables prompt and efficient updating of the algorithm. Using this language modelling approach enables rapid phenotyping without the need for any manually annotated training data across multiple clinical use cases.

Identifiers

PMID38036723
PMCPMC10689487
OpenAlexW4389205282

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.