Evidence map›Paper›PMID 38429353›Full record

ReviewNPJ digital medicine2024

Why do probabilistic clinical models fail to transport between sites.

Thomas A Lasko, Eric V Strobl, William W Stead

Abstract readReview
In one paragraph

Review in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Gaps in artificial intelligence research for rural health in the United States: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  15. PhenoFit: a framework for determining computable phenotyping algorithm fitness for purpose and reuse.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  16. Review
  17. Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Thomas A LaskoVanderbilt University Medical Center, Nashville, TN, USA. tom.lasko@vanderbilt.edu.ORCID http://orcid.org/0000-0003-2300-9529
Eric V StroblVanderbilt University Medical Center, Nashville, TN, USA.
William W SteadVanderbilt University Medical Center, Nashville, TN, USA.ORCID http://orcid.org/0000-0002-5048-9540

Funding

Novel Integrative Approach for the Early Detection of Lung Cancer using Repeated MeasuresR01CA253923 · NCI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI LANDMAN, BENNETT A., MALDONADO, FABIEN · 2021 to 2025
$3.4M
Genome and Phenome to Define Disease Risk with Antinuclear AntibodiesR01AR076516 · NIAMS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI KAWAI, VIVIAN K · 2020 to 2024
$2.8M
Data-Driven Guidance for Timing Repeated Inpatient Laboratory TestsR21LM013807 · NLM · VANDERBILT UNIVERSITY MEDICAL CENTER · PI LASKO, THOMAS · 2022 to 2023
$414k
NCI NIH HHS R01 CA253923NIAMS NIH HHS R01 AR076516NLM NIH HHS R21 LM013807
6 · The paper itself

Abstract

The rising popularity of artificial intelligence in healthcare is highlighting the problem that a computational model achieving super-human clinical performance at its training sites may perform substantially worse at new sites. In this perspective, we argue that we should typically expect this failure to transport, and we present common sources for it, divided into those under the control of the experimenter and those inherent to the clinical data-generating process. Of the inherent sources we look a little deeper into site-specific clinical practices that can affect the data distribution, and propose a potential solution intended to isolate the imprint of those practices on the data from the patterns of disease cause and effect that are the usual target of probabilistic clinical models.

Identifiers

PMID38429353
PMCPMC10907678

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.