Evidence map›Paper›PMID 39304193›Full record

ArticleJournal of neurointerventional surgery2025

Automated detection of large vessel occlusion using deep learning: a pivotal multicenter study and reader performance study.

Jae Guk Kim, Sue Young Ha, You-Ri Kang, Hotak Hong, Dongmin Kim, Myungjae Lee, Leonard Sunwoo, Wi-Sun Ryu, Joon-Tae Kim

Abstract readMulticenter Study
In one paragraph

Article in Journal of neurointerventional surgery, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jae Guk Kim *Department of Neurology, Daejeon Eulji University Hospital, Daejeon, Daejeon, Korea.
Sue Young Ha *Artificial Intelligence Research Center, JLK Inc, Seoul, Korea.ORCID http://orcid.org/0000-0003-2214-1106
You-Ri Kang *Department of Neurology, Chonnam National University Medical School, Gwangju, Korea.
Hotak HongArtificial Intelligence Research Center, JLK Inc, Seoul, Korea.ORCID http://orcid.org/0009-0009-5159-4914
Dongmin KimArtificial Intelligence Research Center, JLK Inc, Seoul, Korea.
Myungjae LeeArtificial Intelligence Research Center, JLK Inc, Seoul, Korea.
Leonard SunwooDepartment of Radiology, Seoul National University Bundang Hospital, Seongnam, Gyeonggi-do, Korea.ORCID http://orcid.org/0000-0003-0374-8658
Wi-Sun RyuArtificial Intelligence Research Center, JLK Inc, Seoul, Korea wisunryu@gmail.com alldelight2@jnu.ac.kr.ORCID http://orcid.org/0000-0002-2823-5253
Joon-Tae KimDepartment of Neurology, Chonnam National University Medical School, Gwangju, Korea wisunryu@gmail.com alldelight2@jnu.ac.kr.ORCID http://orcid.org/0000-0003-4028-8339

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTo evaluate the stand-alone efficacy and improvements in diagnostic accuracy of early-career physicians of the artificial intelligence (AI) software to detect large vessel occlusion (LVO) in CT angiography (CTA).

methodsThis multicenter study included 595 ischemic stroke patients from January 2021 to September 2023. Standard references and LVO locations were determined by consensus among three experts. The efficacy of the AI software was benchmarked against standard references, and its impact on the diagnostic accuracy of four residents involved in stroke care was assessed. The area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity of the software and readers with versus without AI assistance were calculated.

resultsAmong the 595 patients (mean age 68.5±13.4 years, 56% male), 275 (46.2%) had LVO. The median time interval from the last known well time to the CTA was 46.0 hours (IQR 11.8-64.4). For LVO detection, the software demonstrated a sensitivity of 0.858 (95% CI 0.811 to 0.897) and a specificity of 0.969 (95% CI 0.943 to 0.985). In subjects whose symptom onset to imaging was within 24 hours (n=195), the software exhibited an AUROC of 0.973 (95% CI 0.939 to 0.991), a sensitivity of 0.890 (95% CI 0.817 to 0.936), and a specificity of 0.965 (95% CI 0.902 to 0.991). Reading with AI assistance improved sensitivity by 4.0% (2.17 to 5.84%) and AUROC by 0.024 (0.015 to 0.033) (all P<0.001) compared with readings without AI assistance.

conclusionsThe AI software demonstrated a high detection rate for LVO. In addition, the software improved diagnostic accuracy of early-career physicians in detecting LVO, streamlining stroke workflow in the emergency room.

Indexed as

Computed Tomography AngiographyDeep LearningIschemic StrokeAgedAged, 80 and overCerebral AngiographyFemaleHumansMaleMiddle AgedSensitivity and SpecificityCT AngiographyStrokeThrombectomy

Identifiers

PMID39304193
PMCPMC12573350

What Socratic holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.