Evidence map›Paper›PMID 41896751›Full record

ArticleBMC medical research methodology2026

Concerns of AI use in evidence synthesis based practices: collective views from the community.

Hannah O'Keefe, Claire Eastaugh, Feyza Yarar, Jen Taylor, Chris Marshall, Fiona Campbell

Abstract readEvidence Synthesis
In one paragraph

Article in BMC medical research methodology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Hannah O'KeefeNIHR Innovation Observatory, Newcastle University, Newcastle-upon-Tyne, United Kingdom. nho11@newcastle.ac.uk.ORCID http://orcid.org/0000-0002-0107-711X
Claire EastaughNIHR Innovation Observatory, Newcastle University, Newcastle-upon-Tyne, United Kingdom.ORCID http://orcid.org/0000-0002-1371-6601
Feyza YararPopulation Health Sciences Institute, Faculty of Medical Sciences, Newcastle University, Newcastle-upon-Tyne, United Kingdom.
Jen TaylorNIHR Innovation Observatory, Newcastle University, Newcastle-upon-Tyne, United Kingdom.
Chris MarshallNIHR Innovation Observatory, Newcastle University, Newcastle-upon-Tyne, United Kingdom.ORCID http://orcid.org/0000-0002-7970-681X
Fiona CampbellNIHR Innovation Observatory, Newcastle University, Newcastle-upon-Tyne, United Kingdom.ORCID http://orcid.org/0000-0002-4141-8863

Funding

National Institute of Health and Care Research HSRIC-2016-10009/Innovation Observatory
6 · The paper itself

Abstract

backgroundThe use of artificial intelligence (AI) in research has become one of the most hotly debated topics. This is particularly true for the field of evidence synthesis where automation through AI may lead to substantial time and resource savings. Many researchers see the potential benefits of using AI technologies, yet there is hesitation around embedding AI in practice. We explored the concerns of those working in the field of evidence synthesis through a series of online and in-person events.

methodsData collection was conducted across two in-person and 2 online events: the Evidence Synthesis Hackathon (ESH) 2024, the Community, Opportunities, Research and Experience Information Retrieval (CORE) Forum, a Systematic Review Conversations (SRC) online seminar, and an online Horizon Scanning (HS) Survey. Inductive and deductive coding was utilised to synthesis data into broad themes and subthemes, independently for each event. A vote counting and ranking approach was used to triangulate data across events to capture convergent and divergent themes between participant groups.

resultsAcross the four events we acquired a total of 248 data points (from 80 respondents) and responses were broadly similar across cohorts. Through synthesis and triangulation, we identified 10 overarching themes. The most prominent themes were knowledge and skills, and data management, respectively. Skills loss, skills gap and job loss were highlighted within the knowledge and skills theme. Bias, confidentiality and reliability were prominent for data management. Lower ranking concerns included environment, economics, AI market and costs.

conclusionsThese are valid apprehensions faced by researchers across the field of evidence synthesis and should be considered in the broader discussion of AI. Development of rigorous methodologies and guidance may help to overcome these issues by facilitating responsible and transparent use of AI.

Indexed as

Artificial IntelligenceEvidence-Based PracticeData CollectionHumansInformation Storage and RetrievalSurveys and QuestionnairesArtificial IntelligenceConcernsEvidence synthesisHorizon ScanningSystematic Reviews

Identifiers

PMID41896751
PMCPMC13151256

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.