Evidence map›Paper›PMID 39094106›Full record

SynthesisJournal of medical Internet research2024

Implementing AI in Hospitals to Achieve a Learning Health System: Systematic Review of Current Enablers and Barriers.

Amir Kamel Rahimi, Oliver Pienaar, Moji Ghadimi, Oliver J Canfell, Jason D Pole, Sally Shrapnel, Anton H van der Vegt, Clair Sullivan

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 38 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
38citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

38 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Observational
  6. Article
  7. AI-driven multimodal retinal imaging for early detection and risk stratification of vascular and neurodegenerative diseases.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2026
    Review
  8. Article
  9. Review
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Amir Kamel RahimiQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0002-9730-1218
Oliver PienaarThe School of Mathematics and Physics, The University of Queensland, Brisbane, Australia.ORCID 0000-0002-2719-535X
Moji GhadimiThe School of Mathematics and Physics, The University of Queensland, Brisbane, Australia.ORCID 0000-0001-8456-9453
Oliver J CanfellQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0003-2010-3640
Jason D PoleQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0002-0413-5434
Sally ShrapnelQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0001-8407-7176
Anton H van der VegtQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0001-5642-5188
Clair SullivanQueensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia.ORCID 0000-0003-2475-9989

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundEfforts are underway to capitalize on the computational power of the data collected in electronic medical records (EMRs) to achieve a learning health system (LHS). Artificial intelligence (AI) in health care has promised to improve clinical outcomes, and many researchers are developing AI algorithms on retrospective data sets. Integrating these algorithms with real-time EMR data is rare. There is a poor understanding of the current enablers and barriers to empower this shift from data set-based use to real-time implementation of AI in health systems. Exploring these factors holds promise for uncovering actionable insights toward the successful integration of AI into clinical workflows.

objectiveThe first objective was to conduct a systematic literature review to identify the evidence of enablers and barriers regarding the real-world implementation of AI in hospital settings. The second objective was to map the identified enablers and barriers to a 3-horizon framework to enable the successful digital health transformation of hospitals to achieve an LHS.

methodsThe PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were adhered to. PubMed, Scopus, Web of Science, and IEEE Xplore were searched for studies published between January 2010 and January 2022. Articles with case studies and guidelines on the implementation of AI analytics in hospital settings using EMR data were included. We excluded studies conducted in primary and community care settings. Quality assessment of the identified papers was conducted using the Mixed Methods Appraisal Tool and ADAPTE frameworks. We coded evidence from the included studies that related to enablers of and barriers to AI implementation. The findings were mapped to the 3-horizon framework to provide a road map for hospitals to integrate AI analytics.

resultsOf the 1247 studies screened, 26 (2.09%) met the inclusion criteria. In total, 65% (17/26) of the studies implemented AI analytics for enhancing the care of hospitalized patients, whereas the remaining 35% (9/26) provided implementation guidelines. Of the final 26 papers, the quality of 21 (81%) was assessed as poor. A total of 28 enablers was identified; 8 (29%) were new in this study. A total of 18 barriers was identified; 5 (28%) were newly found. Most of these newly identified factors were related to information and technology. Actionable recommendations for the implementation of AI toward achieving an LHS were provided by mapping the findings to a 3-horizon framework.

conclusionsSignificant issues exist in implementing AI in health care. Shifting from validating data sets to working with live data is challenging. This review incorporated the identified enablers and barriers into a 3-horizon framework, offering actionable recommendations for implementing AI analytics to achieve an LHS. The findings of this study can assist hospitals in steering their strategic planning toward successful adoption of AI.

Indexed as

Artificial IntelligenceLearning Health SystemElectronic Health RecordsHospitalsHumansartificial intelligenceclinicaldecision support systemelectronic health recordslife cyclemachine learningmedical informaticsroutinely collected health data

Identifiers

PMID39094106
PMCPMC11329852

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.