Evidence map›Paper›PMID 40725418›Full record

ArticleGenes2025

The Artificial Intelligence-Assisted Diagnosis of Skeletal Dysplasias in Pediatric Patients: A Comparative Benchmark Study of Large Language Models and a Clinical Expert Group.

Nikola Ilić, Nina Marić, Dimitrije Cvetković, Marko Bogosavljević, Gordana Bukara-Radujković, Jovana Krstić, Zoran Paunović, Ninoslav Begović, Sanja Panić Zarić, Slađana Todorović and 3 more

Abstract readComparative Study
In one paragraph

Article in Genes, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Nikola IlićClinical Genetics Outpatient Clinic, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.ORCID 0000-0003-1186-208X
Nina MarićClinic for Children Diseases, University Clinical Center of the Republic of Srpska, 78000 Banja Luka, Bosnia and Herzegovina.ORCID 0000-0003-3143-3098
Dimitrije CvetkovićDepartment of Endocrinology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Marko BogosavljevićDepartment of Orthopedic Surgery and Traumatology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Gordana Bukara-RadujkovićClinic for Children Diseases, University Clinical Center of the Republic of Srpska, 78000 Banja Luka, Bosnia and Herzegovina.
Jovana KrstićClinical Genetics Outpatient Clinic, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Zoran PaunovićDepartment of Orthopedic Surgery and Traumatology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Ninoslav BegovićDepartment of Orthopedic Surgery and Traumatology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.ORCID 0000-0002-5440-5404
Sanja Panić ZarićDepartment of Endocrinology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Slađana TodorovićDepartment of Endocrinology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.
Katarina MitrovićDepartment of Endocrinology, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.ORCID 0000-0002-3328-8739
Aleksandar VlahovićDepartment of Surgery, Division of Pediatric Surgery, University of Belgrade, 11000 Belgrade, Serbia.
Adrijan SarajlijaClinical Genetics Outpatient Clinic, Mother and Child Health Care Institute of Serbia "Dr Vukan Cupic", 11070 Belgrade, Serbia.ORCID 0000-0001-8024-6737

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

BACKGROUND/

objectivesSkeletal dysplasias are a heterogeneous group of rare genetic disorders with diverse and overlapping clinical presentations, posing diagnostic challenges even for experienced clinicians. With the increasing availability of artificial intelligence (AI) in healthcare, large language models (LLMs) offer a novel opportunity to assist in rare disease diagnostics. This study aimed to compare the diagnostic accuracy of two advanced LLMs, ChatGPT (version GPT-4) and DeepSeek, with that of a clinical expert panel in a cohort of pediatric patients with genetically confirmed skeletal dysplasias.

methodsWe designed a prospective vignette-based diagnostic benchmarking study including 45 children with confirmed skeletal dysplasias from two tertiary centers. Both LLMs were prompted to provide primary and differential diagnoses based on standardized clinical case vignettes. Their outputs were compared with those of two human experts (a pediatric endocrinologist and a pediatric orthopedic surgeon), using molecular diagnosis as the gold standard.

resultsChatGPT and DeepSeek achieved a comparable diagnostic top-3 accuracy (62.2% and 64.4%, respectively), with a high intermodel agreement (Cohen's κ = 0.95). The expert panel outperformed both models (82.2%). While LLMs performed well on more common disorders, they struggled with ultra-rare and multisystemic conditions. In one complex case missed by experts, the DeepSeek model successfully proposed the correct diagnosis.

conclusionsLLMs offer a complementary diagnostic value in skeletal dysplasias, especially in under-resourced medical settings. Their integration as a supportive tool in multidisciplinary diagnostic workflows may enhance early recognition and reduce diagnostic delays in rare disease care.

Indexed as

Artificial IntelligenceBone Diseases, DevelopmentalAdolescentBenchmarkingChildChild, PreschoolFemaleHumansInfantLarge Language ModelsMaleProspective Studiesartificial intelligence (AI)ChatGPTDeepSeekdiagnostic benchmarkinglarge language models (LLMs)pediatric geneticsskeletal dysplasia

Identifiers

PMID40725418
PMCPMC12294814

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.