Evidence map›Paper›PMID 41276153›Full record

ArticleJournal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus2025

External validation of an artificial intelligence-based model for retinopathy of prematurity screening using Phoenix ICON retinal images.

Lizanne A Derks, Y Selim Tekin, Sjoukje E Loudon, Johannes R Vingerling, Aaron S Coyner, J Peter Campbell, Angela M Tjiam

Abstract readValidation Study
In one paragraph

Article in Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Lizanne A DerksDepartment of Ophthalmology, Erasmus University Medical Center, Rotterdam, The Netherlands. Electronic address: L.derks@erasmusmc.nl.
Y Selim TekinDepartment of Ophthalmology, Erasmus University Medical Center, Rotterdam, The Netherlands.
Sjoukje E LoudonDepartment of Ophthalmology, Erasmus University Medical Center, Rotterdam, The Netherlands.
Johannes R VingerlingDepartment of Ophthalmology, Erasmus University Medical Center, Rotterdam, The Netherlands.
Aaron S CoynerCasey Eye Institute, Oregon Health & Science University, Portland, Oregon.
J Peter CampbellCasey Eye Institute, Oregon Health & Science University, Portland, Oregon.
Angela M TjiamDepartment of Ophthalmology, Erasmus University Medical Center, Rotterdam, The Netherlands.

Funding

Proteomics CoreP30EY010572 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI TED S ACOTT · 1995 to 2026
$19.4M
Clinical and Genetic Analysis of Retinopathy of PrematurityR01EY019474 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2010 to 2020
$7.0M
Artificial Intelligence Assisted Panoramic Optical Coherence Tomography Angiography for Retinopathy of PrematurityR01HD107494 · NICHD · OREGON HEALTH & SCIENCE UNIVERSITY · PI John Peter Campbell, Yifan Jian · 2021 to 2026
$2.4M
Validation of artificial intelligence (AI) based software as medical device (SaMD) for retinopathy of prematurity (ROP)R44EY035596 · NEI · SILOAM VISION, INC. · PI CAMPBELL, JOHN PETER, JONAS, KARYN · 2023 to 2024
$2.0M
Clinical and genetic analysis of retinopathy of prematurityR01HD107493 · NICHD · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2021 to 2023
$1.8M
Robust AI to develop risk models in retinopathy of prematurity using deep learningR21EY031883 · NEI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE, RUBIN, DANIEL L · 2020 to 2021
$472k
Artificial intelligence assisted panoramic Optical Coherence Tomography Angiography for Retinopathy of PrematurityR01EY031331 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER, JIAN, YIFAN · 2020 to 2020
$342k
NEI NIH HHS P30 EY010572NEI NIH HHS R01 EY019474NEI NIH HHS R01 EY031331NEI NIH HHS R21 EY031883NEI NIH HHS R44 EY035596NICHD NIH HHS R01 HD107493NICHD NIH HHS R01 HD107494
6 · The paper itself

Abstract

purposeTo assess the performance of a RetCam-trained artificial intelligence (AI) algorithm for the autonomous detection of severe retinopathy of prematurity (ROP) using retinal images acquired with the smaller field-of-view Phoenix ICON retinal camera.

methodsRetrospective external validation was performed using Phoenix ICON retinal images captured during ROP screening examinations in a Dutch cohort of infants born in 2021. Images of insufficient quality were excluded via automated quality assessment. Model performances for more-than-mild ROP (MTM-ROP)-type 1 or 2 ROP, or any ROP with pre-plus disease-and for type 1 ROP alone, were expressed as area under the precision-recall curve (AUPRC), sensitivity and specificity.

resultsA total of 4,411 images from 66 infants were captured during 419 individual eye examinations, averaging 67 ± 65 images per infant and 10 ± 6 images per eye examination. Sixty examinations (14.3%) had all images excluded in automated quality assessment. When using the best performance between both eyes to assess infant-level performance, AUPRC was 0.911 (95% CI, 0.638-1.000), sensitivity was 82.0% (95% CI, 73.0-89.0) and specificity was 77.0% (95% CI, 68.1-84.4) for MTM-ROP. For type 1 ROP alone, AUPRC was 0.983 (95% CI, 0.964-1.000), sensitivity was 100.0% (95% CI, 94.7-100.0), and specificity was 72.4% (95% CI, 64.4-79.5).

conclusionsThe algorithm's performance with Phoenix ICON is similar to its performance with RetCam. All infants with treatment-requiring type 1 ROP were detected by the algorithm. The presence of eye examinations without images of sufficient quality underlines the need for imaging protocols, especially when using this algorithm, with a smaller field-of-view camera.

Indexed as

Artificial IntelligenceNeonatal ScreeningPhotographyRetinaRetinopathy of PrematurityAlgorithmsFemaleGestational AgeHumansInfant, NewbornMaleReproducibility of ResultsRetrospective StudiesSensitivity and Specificity

Identifiers

PMID41276153
PMCPMC13345673

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.