Evidence map›Paper›PMID 39152209›Full record

ArticleNPJ digital medicine2024

Harnessing the power of longitudinal medical imaging for eye disease prognosis using Transformer-based sequence modeling.

Gregory Holste, Mingquan Lin, Ruiwen Zhou, Fei Wang, Lei Liu, Qi Yan, Sarah H Van Tassel, Kyle Kovacs, Emily Y Chew, Zhiyong Lu and 2 more

Erratum issuedAbstract read
In one paragraph

Article in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Review
  8. AMD-Mamba: A Phenotype-Aware Multi-modal Framework for Robust AMD Prognosis.Machine learning in medical imaging. MLMI (Workshop) · 2026
    Article
  9. Two-Stage Decoupling Framework for Variable-Length Glaucoma Prognosis.Learning with longitudinal medical images and data : first International Workshop, LMID 2025, held in conjunction with MICCAI 2025, Daejeon, South Korea, September 27, 2025, Proceedings. International Workshop on Learning with Longitudi... · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Time-to-Event Pretraining for 3D Medical Imaging.... International Conference on Learning Representations · 2025
    Article
  14. Article
  15. The Boundaries of Fair AI in Medical Image Prognosis: A Causal Perspective.Advances in neural information processing systems · 2025
    Article
  16. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Gregory HolsteDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0002-5657-3081
Mingquan LinDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0003-0862-6588
Ruiwen ZhouCenter for Biostatistics and Data Science, Washington University School of Medicine, St. Louis, MO, USA.
Fei WangDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0001-9459-9461
Lei LiuCenter for Biostatistics and Data Science, Washington University School of Medicine, St. Louis, MO, USA.
Qi YanDepartment of Obstetrics & Gynecology, Columbia University Irving Medical Center, New York, NY, USA.ORCID http://orcid.org/0000-0002-5236-9673
Sarah H Van TasselIsrael Englander Department of Ophthalmology, Weill Cornell Medicine, New York, NY, USA.
Kyle KovacsIsrael Englander Department of Ophthalmology, Weill Cornell Medicine, New York, NY, USA.
Emily Y ChewDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health (NIH), Bethesda, MD, USA.ORCID http://orcid.org/0000-0003-0999-9802
Zhiyong LuNational Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Zhangyang WangDepartment of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, USA. atlaswang@utexas.edu.
Yifan PengDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA. yip4002@med.cornell.edu.ORCID http://orcid.org/0000-0001-9309-8331

Funding

OCULAR HYPERTENSION TREATMENT STUDY (OHTS)U10EY009307 · NEI · WASHINGTON UNIVERSITY · PI KASS, MICHAEL A · 1992 to 2009
$14.8M
OHTS DATA COORDINATIONU10EY009341 · NEI · WASHINGTON UNIVERSITY · PI GORDON, MAE O · 1992 to 2009
$12.3M
Machine learning for medical imaging: automated disease diagnosis and prognosisZIALM010021 · NLM · NATIONAL LIBRARY OF MEDICINE · PI LU, ZHIYONG · 2022 to 2025
$4.1M
Achieving Model Fairness on Automatic Primary Open-angle Glaucoma ScreeningR21EY035296 · NEI · WEILL MEDICAL COLL OF CORNELL UNIV · PI PENG, YIFAN · 2023 to 2023
$466k
NEI NIH HHS R21 EY035296NEI NIH HHS U10 EY009307NEI NIH HHS U10 EY009341U.S. Department of Health & Human Services | NIH | National Eye Institute (NEI) R21EY035296
6 · The paper itself

Abstract

Deep learning has enabled breakthroughs in automated diagnosis from medical imaging, with many successful applications in ophthalmology. However, standard medical image classification approaches only assess disease presence at the time of acquisition, neglecting the common clinical setting of longitudinal imaging. For slow, progressive eye diseases like age-related macular degeneration (AMD) and primary open-angle glaucoma (POAG), patients undergo repeated imaging over time to track disease progression and forecasting the future risk of developing a disease is critical to properly plan treatment. Our proposed Longitudinal Transformer for Survival Analysis (LTSA) enables dynamic disease prognosis from longitudinal medical imaging, modeling the time to disease from sequences of fundus photography images captured over long, irregular time periods. Using longitudinal imaging data from the Age-Related Eye Disease Study (AREDS) and Ocular Hypertension Treatment Study (OHTS), LTSA significantly outperformed a single-image baseline in 19/20 head-to-head comparisons on late AMD prognosis and 18/20 comparisons on POAG prognosis. A temporal attention analysis also suggested that, while the most recent image is typically the most influential, prior imaging still provides additional prognostic value.

Identifiers

PMID39152209
PMCPMC11329720

What Socratic holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.