Evidence map›Paper›PMID 38738798›Full record

ArticleAnnals of medicine2024

Comparison of 21 artificial intelligence algorithms in automated diabetic retinopathy screening using handheld fundus camera.

Anna-Maria Kubin, Petri Huhtinen, Pasi Ohtonen, Antti Keskitalo, Joonas Wirkkala, Nina Hautala

Abstract readComparative Study
In one paragraph

Article in Annals of medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Artificial intelligence in diabetic retinopathy: from automated screening to risk-stratified care.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2026
    Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Diabetic retinal disease.Nature reviews. Disease primers · 2025
    Review
  8. Article
  9. Review
  10. Review
  11. Artificial Intelligence to Diagnose Complications of Diabetes.Journal of diabetes science and technology · 2025
    Review
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Anna-Maria KubinDepartment of Ophthalmology, Oulu University Hospital, Oulu, Finland.
Petri HuhtinenOptomed, Oulu, Finland.
Pasi OhtonenResearch Service Unit, Oulu, Finland.
Antti KeskitaloDepartment of Ophthalmology, Oulu University Hospital, Oulu, Finland.
Joonas WirkkalaDepartment of Ophthalmology, Oulu University Hospital, Oulu, Finland.
Nina HautalaDepartment of Ophthalmology, Oulu University Hospital, Oulu, Finland.ORCID 0000-0001-5454-5602

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDiabetic retinopathy (DR) is a common complication of diabetes and may lead to irreversible visual loss. Efficient screening and improved treatment of both diabetes and DR have amended visual prognosis for DR. The number of patients with diabetes is increasing and telemedicine, mobile handheld devices and automated solutions may alleviate the burden for healthcare. We compared the performance of 21 artificial intelligence (AI) algorithms for referable DR screening in datasets taken by handheld Optomed Aurora fundus camera in a real-world setting. PATIENTS AND

methodsProspective study of 156 patients (312 eyes) attending DR screening and follow-up. Both papilla- and macula-centred 50° fundus images were taken from each eye. DR was graded by experienced ophthalmologists and 21 AI algorithms.

resultsMost eyes, 183 out of 312 (58.7%), had no DR and mild NPDR was noted in 21 (6.7%) of the eyes. Moderate NPDR was detected in 66 (21.2%) of the eyes, severe NPDR in 1 (0.3%), and PDR in 41 (13.1%) composing a group of 34.6% of eyes with referable DR. The AI algorithms achieved a mean agreement of 79.4% for referable DR, but the results varied from 49.4% to 92.3%. The mean sensitivity for referable DR was 77.5% (95% CI 69.1-85.8) and specificity 80.6% (95% CI 72.1-89.2). The rate for images ungradable by AI varied from 0% to 28.2% (mean 1.9%). Nineteen out of 21 (90.5%) AI algorithms resulted in grading for DR at least in 98% of the images.

conclusionsFundus images captured with Optomed Aurora were suitable for DR screening. The performance of the AI algorithms varied considerably emphasizing the need for external validation of screening algorithms in real-world settings before their clinical application.

Indexed as

AlgorithmsArtificial IntelligenceDiabetic RetinopathyFundus OculiAdultAgedFemaleHumansMaleMass ScreeningMiddle AgedPhotographyProspective StudiesSensitivity and Specificityartificial intelligenceDiabetesdiabetic retinopathyhandheld fundus camerascreening

Identifiers

PMID38738798
PMCPMC11095279

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.