Evidence map›Paper›PMID 38259208›Full record

ReviewRadiology2024

Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology.

Allison Chae, Michael S Yao, Hersh Sagreiya, Ari D Goldberg, Neil Chatterjee, Matthew T MacLean, Jeffrey Duda, Ameena Elahi, Arijitt Borthakur, Marylyn D Ritchie and 4 more

Abstract readReview
In one paragraph

Review in Radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. A Cloud-Based System for Automated AI Image Analysis and Reporting.Journal of imaging informatics in medicine · 2025
    Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Towards equitable AI in oncology.Nature reviews. Clinical oncology · 2024
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Allison Chae *From the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0001-7029-556X
Michael S Yao *From the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-7008-6028
Hersh SagreiyaFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-2909-6793
Ari D GoldbergFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).
Neil ChatterjeeFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).
Matthew T MacLeanFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).
Jeffrey DudaFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-5031-5735
Ameena ElahiFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0001-6938-1735
Arijitt BorthakurFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0001-5763-8847
Marylyn D RitchieFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-1208-1720
Daniel RaderFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-9245-9876
Charles E KahnFrom the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-6654-7434
Walter R Witschey *From the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0003-1669-2120
James C Gee *From the Departments of Bioengineering (M.S.Y.), Radiology (H.S., N.C., M.T.M., J.D., A.B., C.E.K., W.R.W., J.C.G.), Genetics (M.D.R.), and Medicine (D.R.), Perelman School of Medicine (A.C., M.S.Y., H.S., A.B., C.E.K., W.R.W., J.C.G.), University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104; Department of Radiology, Loyola University Medical Center, Maywood, Ill (A.D.G.); Department of Information Services, University of Pennsylvania, Philadelphia, Pa (A.E.); and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pa (A.B.).ORCID 0000-0002-2258-0187

Funding

High Spatial and Temporal Resolution MRI Mapping of Oxygen Consumption in HumansP41EB029460 · NIBIB · UNIVERSITY OF PENNSYLVANIA · PI Ravinder Reddy · 2021 to 2026
$7.6M
RESEARCH TRACK RADIOLOGY RESIDENCYT32EB004311 · NIBIB · UNIVERSITY OF PENNSYLVANIA · PI Terence P Gade, Misun Hwang · 2005 to 2026
$4.5M
Training Program in Biomedical Imaging and Information SciencesT32EB009384 · NIBIB · UNIVERSITY OF PENNSYLVANIA · PI GEE, JAMES C, IVES, ZACHARY · 2009 to 2023
$4.0M
Cardiac MR imaging of hemorrhagic reperfusion injury after myocardial infarctionR01HL137984 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI WITSCHEY, WALTER R.T. · 2018 to 2022
$2.8M
ITK-Lung: A Software Framework for Lung Image Processing and AnalysisR01HL133889 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI GEE, JAMES C · 2017 to 2020
$2.3M
NHLBI NIH HHS R01 HL133889NHLBI NIH HHS R01 HL137984NIBIB NIH HHS P41 EB029460NIBIB NIH HHS T32 EB004311NIBIB NIH HHS T32 EB009384
6 · The paper itself

Abstract

Despite recent advancements in machine learning (ML) applications in health care, there have been few benefits and improvements to clinical medicine in the hospital setting. To facilitate clinical adaptation of methods in ML, this review proposes a standardized framework for the step-by-step implementation of artificial intelligence into the clinical practice of radiology that focuses on three key components: problem identification, stakeholder alignment, and pipeline integration. A review of the recent literature and empirical evidence in radiologic imaging applications justifies this approach and offers a discussion on structuring implementation efforts to help other hospital practices leverage ML to improve patient care. Clinical trial registration no. 04242667 © RSNA, 2024

Indexed as

Artificial IntelligenceRadiologyAlgorithmsHumansMachine LearningRadiography

Identifiers

PMID38259208
PMCPMC10831483

What Socratic holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.