Evidence map›Paper›PMID 40065263›Full record

ArticleBMC neurology2025

A multicenter validation and calibration of automated software package for detecting anterior circulation large vessel occlusion on CT angiography.

Kyu Sun Yum, Jong-Won Chung, Sue Young Ha, Kwang-Yeol Park, Dong-Ick Shin, Hong-Kyun Park, Yong-Jin Cho, Keun-Sik Hong, Jae Guk Kim, Soo Joo Lee and 10 more

Abstract readMulticenter StudyValidation Study
In one paragraph

Article in BMC neurology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Kyu Sun Yum *Department of Neurology, College of Medicine, Chungbuk National University Hospital, Chungbuk National University, Cheongju, Republic of Korea.
Jong-Won Chung *Department of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea.
Sue Young HaArtificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea.
Kwang-Yeol ParkDepartment of Neurology, Chung-Ang University College of Medicine, Chung-Ang University Hospital, Seoul, Republic of Korea.
Dong-Ick ShinDepartment of Neurology, College of Medicine, Chungbuk National University Hospital, Chungbuk National University, Cheongju, Republic of Korea.
Hong-Kyun ParkDepartment of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea.
Yong-Jin ChoDepartment of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea.
Keun-Sik HongDepartment of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea.
Jae Guk KimDepartment of Neurology, Daejeon Eulji Medical Center, Eulji University School of Medicine, Daejeon, Republic of Korea.
Soo Joo LeeDepartment of Neurology, Daejeon Eulji Medical Center, Eulji University School of Medicine, Daejeon, Republic of Korea.
Joon-Tae KimDepartment of Neurology, Chonnam National University Hospital, Chonnam National University Medical School, Gwangju, Republic of Korea.
Woo-Keun SeoDepartment of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea.
Oh Young BangDepartment of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea.
Gyeong-Moon KimDepartment of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea.
Myungjae LeeArtificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea.
Dongmin KimArtificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea.
Leonard SunwooDepartment of Radiology, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Hee-Joon BaeDepartment of Neurology, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Wi-Sun RyuArtificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea. wisunryu@gmail.com.
Beom Joon KimDepartment of Neurology, Seoul National University College of Medicine, Seongnam, Republic of Korea. kim.bj.stroke@gmail.com.

Funding

Ministry of Health and Welfare HI22C0454Multiministry Grant for Medical Device Development KMDF_PR_20200901_0098
6 · The paper itself

Abstract

purposeTo validate JLK-LVO, a software detecting large vessel occlusion (LVO) on computed tomography angiography (CTA), within a multicenter dataset.

methodsFrom 2021 to 2023, we enrolled patients with ischemic stroke who underwent CTA within 24-hour of onset at six university hospitals for validation and calibration datasets and at another university hospital for an independent dataset for testing model calibration. The diagnostic performance was evaluated using area under the curve (AUC), sensitivity, and specificity across the entire study population and specifically in patients with isolated middle cerebral artery (MCA)-M2 occlusion. We calibrated LVO probabilities using logistic regression and by grouping LVO probabilities based on observed frequency.

resultsAfter excluding 168 patients, 796 remained; the mean (SD) age was 68.9 (13.7) years, and 57.7% were men. LVO was present in 193 (24.3%) of patients, and the median interval from last-known-well to CTA was 5.7 h (IQR 2.5-12.1 h). The software achieved an AUC of 0.944 (95% CI 0.926-0.960), with a sensitivity of 89.6% (84.5-93.6%) and a specificity of 90.4% (87.7-92.6%). In isolated MCA-M2 occlusion, the AUROC was 0.880 (95% CI 0.824-0.921). Due to sparse data between 20 and 60% of LVO probabilities, recategorization into unlikely (0-20% LVO scores), less likely (20-60%), possible (60-90%), and suggestive (90-100%) provided a reliable estimation of LVO compared with mathematical calibration. The category of LVO probabilities was associated with follow-up infarct volumes and functional outcome.

conclusionIn this multicenter study, we proved the clinical efficacy of the software in detecting LVO on CTA.

Indexed as

Computed Tomography AngiographyInfarction, Middle Cerebral ArteryIschemic StrokeSoftwareAgedAged, 80 and overCalibrationFemaleHumansMaleMiddle AgedSensitivity and SpecificityArtificial intelligenceComputed tomography angiographyIschemic strokeLarge vessel occlusion

Identifiers

PMID40065263
PMCPMC11892136

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.