Evidence mapPaperPMID 41370833Full record

ArticleJMIR AI2025

Transparent Reporting of AI in Systematic Literature Reviews: Development of the PRISMA-trAIce Checklist.

Dirk Holst, Keno Moenck, Julian Koch, Ole Schmedemann, Thorsten Schüppstuhl

Abstract read
In one paragraph

Article in JMIR AI, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Reporting the use of AI in horizon scanning: a brief communication on methodological standards.International journal of technology assessment in health care · 2026
    Article
  2. Review
  3. Article
  4. Accuracy in spinal level determination, including transitional vertebrae: an ASReview supported systematic review.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Review
  5. Evaluating AI Performance in Systematic Literature Reviews for HEOR: A Case Study.Journal of health economics and outcomes research · 2026
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Dirk Holst *Institute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.ORCID http://orcid.org/0000-0001-9918-349X
Keno Moenck *Institute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.ORCID http://orcid.org/0000-0003-3892-1588
Julian Koch *Institute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.ORCID http://orcid.org/0000-0003-3700-6425
Ole SchmedemannInstitute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.ORCID http://orcid.org/0000-0001-6488-5141
Thorsten SchüppstuhlInstitute of Aircraft Production Technology, Hamburg University of Technology, Am Schwarzenberg-Campus 1, Hamburg, 21073, Germany, 49 17689103318, 49 40427314551.ORCID http://orcid.org/0000-0002-9616-3976

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Systematic literature reviews (SLRs) build the foundation for evidence synthesis, but they are exceptionally demanding in terms of time and resources. While recent advances in artificial intelligence (AI), particularly large language models, offer the potential to accelerate this process, their use introduces challenges to transparency and reproducibility. Reporting guidelines such as the PRISMA-AI (Preferred Reporting Items for Systematic Reviews and Meta-Analyses-Artificial Intelligence Extension) primarily focus on AI as a subject of research, not as a tool in the review process itself. Objective: To address the gap in reporting standards, this study aimed to develop and propose a discipline-agnostic checklist extension to the PRISMA 2020 statement. The goal was to ensure transparent reporting when AI is used as a methodological tool in evidence synthesis, fostering trust in the next generation of SLRs. Methods: The proposed checklist, named PRISMA-trAIce (PRISMA-Transparent Reporting of Artificial Intelligence in Comprehensive Evidence Synthesis), was developed through a systematic process. We conducted a literature search to identify established, consensus-based AI reporting guidelines (eg, CONSORT-AI [Consolidated Standards of Reporting Trials-Artificial Intelligence] and TRIPOD-AI [Transparent Reporting of a Multivariable Prediction Model of Individual Prognosis or Diagnosis-Artificial Intelligence]). Relevant items from these frameworks were extracted, analyzed, and thematically synthesized to form a modular checklist that integrated with the PRISMA 2020 structure. Results: The primary result of this work is the PRISMA-trAIce checklist, a comprehensive set of reporting items designed to document the use of AI in SLRs. The checklist covers the entire structure of an SLR, from title and abstract to methods and discussion, and includes specific items for identifying AI tools, describing human-AI interaction, reporting performance evaluation, and discussing limitations. Conclusions: PRISMA-trAIce establishes an important framework to improve the transparency and methodological integrity of AI-assisted systematic reviews, enhancing the trust required for the responsible application of AI-assisted systematic reviews in evidence synthesis. We present this work as a foundational proposal, explicitly inviting the scientific community to join an open science process of consensus building. Through this collaborative refinement, we aim to evolve PRISMA-trAIce into a formally endorsed guideline, thereby ensuring the collective validation and scientific rigor of future AI-driven research.

Indexed as

AIartificial intelligenceevidence synthesislarge language modelsPreferred Reporting Items for Systematic Reviews and Meta-AnalysesPRISMAreporting guidelinesystematic literature reviewtransparency

Identifiers

PMID41370833
PMCPMC12694947

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.