Evidence map›Paper›PMID 38559062›Full record

ArticlemedRxiv : the preprint server for health sciences2024

Automated Extraction of Stroke Severity from Unstructured Electronic Health Records using Natural Language Processing.

Marta Fernandes, M Brandon Westover, Aneesh B Singhal, Sahar F Zafar

Abstract readPreprint
In one paragraph

Article in medRxiv : the preprint server for health sciences, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Marta FernandesDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, United States.ORCID 0000-0002-7203-2832
M Brandon WestoverDepartment of Neurology, Beth Israel Deaconess Medical Center (BIDMC), Boston, Massachusetts, United States.
Aneesh B SinghalDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, United States.ORCID 0000-0002-2641-5277
Sahar F ZafarDepartment of Neurology, Massachusetts General Hospital (MGH), Boston, Massachusetts, United States.

Funding

Late-onset Unexplained Epilepsy as a Risk Factor for DementiaR01NS130119 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI Alice D Lam · 2023 to 2026
$8.7M
Data-Driven Sleep Biomarkers of Brain Health, Heart Health, and MortalityR01HL161253 · NHLBI · BETH ISRAEL DEACONESS MEDICAL CENTER · PI CLIFFORD, GARI DAVID, MIGNOT, EMMANUEL J · 2022 to 2025
$8.3M
Comparative Safety of Seizure Prophylaxis within the Medicare ProgramR01AG073410 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI Lidia Maria Veras Rocha de Moura · 2021 to 2026
$4.1M
Low Neurophysiologic Resistance to Anesthetics as a Marker of Preclinical/Prodromal Alzheimer's Disease and Neurovascular Pathology, Delirium risk and InattentionR01AG073598 · NIA · STANFORD UNIVERSITY · PI Miles Berger · 2022 to 2026
$3.8M
Integrative Motor Activity Biomarker for the Risk of Alzheimer's RiskRF1AG064312 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI HU, KUN · 2019 to 2019
$3.6M
Traumatic Brain Injury Anti-Seizure Prophylaxis in the Medicare ProgramR01AG082693 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI Lidia Maria Veras Rocha de Moura, Sahar F Zafar · 2023 to 2026
$3.3M
Prospective Validation of Neurophysiologic Outcome Prediction in Acute Brain InjuryR01NS126282 · NINDS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI Aaron F Struck, Michael Brandon Westover · 2023 to 2026
$2.9M
Establishing a Brain Health Index from the Sleep ElectroencephalogramRF1NS120947 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI CASH, SYDNEY S, THOMAS, ROBERT JOSEPH · 2021 to 2021
$2.4M
Comparative Effectiveness of EEG-Guided Anti-Seizure Treatment in Acute Brain InjuryR01NS131347 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI Sahar F Zafar · 2024 to 2026
$1.9M
Optimizing anti-epileptic drug treatment in acute brain injuryK23NS114201 · NINDS · MASSACHUSETTS GENERAL HOSPITAL · PI ZAFAR, SAHAR F · 2019 to 2023
$1.0M
NHLBI NIH HHS R01 HL161253NIA NIH HHS R01 AG073410NIA NIH HHS R01 AG073598NIA NIH HHS R01 AG082693NIA NIH HHS RF1 AG064312NINDS NIH HHS K23 NS114201NINDS NIH HHS R01 NS126282NINDS NIH HHS R01 NS130119NINDS NIH HHS R01 NS131347NINDS NIH HHS RF1 NS120947
6 · The paper itself

Abstract

backgroundMulti-center electronic health records (EHR) can support quality improvement initiatives and comparative effectiveness research in stroke care. However, limitations of EHR-based research include challenges in abstracting key clinical variables from non-structured data at scale. This is further compounded by missing data. Here we develop a natural language processing (NLP) model that automatically reads EHR notes to determine the NIH stroke scale (NIHSS) score of patients with acute stroke.

methodsThe study included notes from acute stroke patients (>= 18 years) admitted to the Massachusetts General Hospital (MGH) (2015-2022). The MGH data were divided into training (70%) and hold-out test (30%) sets. A two-stage model was developed to predict the admission NIHSS. A linear model with the least absolute shrinkage and selection operator (LASSO) was trained within the training set. For notes in the test set where the NIHSS was documented, the scores were extracted using regular expressions (stage 1), for notes where NIHSS was not documented, LASSO was used for prediction (stage 2). The reference standard for NIHSS was obtained from Get With The Guidelines Stroke Registry. The two-stage model was tested on the hold-out test set and validated in the MIMIC-III dataset (Medical Information Mart for Intensive Care-MIMIC III 2001-2012) v1.4, using root mean squared error (RMSE) and Spearman correlation (SC).

resultsWe included 4,163 patients (MGH = 3,876; MIMIC = 287); average age of 69 [SD 15] years; 53% male, and 72% white. 90% patients had ischemic stroke and 10% hemorrhagic stroke. The two-stage model achieved a RMSE [95% CI] of 3.13 [2.86-3.41] (SC = 0.90 [0.88-0. 91]) in the MGH hold-out test set and 2.01 [1.58-2.38] (SC = 0.96 [0.94-0.97]) in the MIMIC validation set.

conclusionsThe automatic NLP-based model can enable large-scale stroke severity phenotyping from EHR and therefore support real-world quality improvement and comparative effectiveness studies in stroke.

Indexed as

Electronic Health RecordsMachine LearningNational Institutes of Health Stroke ScaleNatural Language ProcessingPhenotypingStroke

Identifiers

PMID38559062
PMCPMC10980121

What Socratic holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.