Evidence map›Paper›PMID 40074237›Full record

Trial reportBMJ evidence-based medicine2025

Improving peer review of systematic reviews and related review types by involving librarians and information specialists as methodological peer reviewers: a randomised controlled trial.

Melissa L Rethlefsen, Sara Schroter, Lex M Bouter, Jamie J Kirkham, David Moher, Ana Patricia Ayala, David Blanco, Tara J Brigham, Holly K Grossetta Nardini, Shona Kirtley and 3 more

Abstract readRandomized Controlled TrialPragmatic Clinical Trial
In one paragraph

Trial report in BMJ evidence-based medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Melissa L RethlefsenHealth Sciences Library and Informatics Center, University of New Mexico Health Sciences Center, Albuquerque, New Mexico, USA mlrethlefsen@gmail.com.ORCID 0000-0001-5322-9368
Sara SchroterEditorial, BMJ, London, UK.
Lex M BouterEpidemiology and Data Science, Amsterdam UMC Location AMC, Amsterdam, The Netherlands.ORCID 0000-0002-2659-5482
Jamie J KirkhamBiostatistics, Manchester University, Manchester, UK.ORCID 0000-0003-2579-9325
David MoherCentre of Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Ana Patricia AyalaGerstein Science Information Centre, University of Toronto, Toronto, Ontario, Canada.
David BlancoDepartment of Physiotherapy, Universitat Internacional de Catalunya, Barcelona, Spain.
Tara J BrighamMayo Clinic Libraries, Mayo Clinic in Florida, Jacksonville, Florida, USA.ORCID 0000-0002-2175-4819
Holly K Grossetta NardiniHarvey Cushing/John Hay Whitney Medical Library, Yale University, New Haven, Connecticut, USA.ORCID 0000-0001-5563-6848
Shona KirtleyUK EQUATOR Centre, Centre for Statistics in Medicine, University of Oxford Nuffield Department of Orthopaedics Rheumatology and Musculoskeletal Sciences, Oxford, UK.
Kate NyhanHarvey Cushing/John Hay Whitney Medical Library, Yale University, New Haven, Connecticut, USA.ORCID 0000-0001-5397-2303
Whitney TownsendUniversity of Michigan Taubman Health Sciences Library, Ann Arbor, Michigan, USA.
Maurice ZeegersDepartment of Epidemiology, Maastricht University Care and Public Health Research Institute, Maastricht, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo evaluate the impact of adding librarians and information specialists (LIS) as methodological peer reviewers to the formal journal peer review process on the quality of search reporting and risk of bias in systematic review searches in the medical literature.

designPragmatic two-group parallel randomised controlled trial.

settingThree biomedical journals.

participantsSystematic reviews and related evidence synthesis manuscripts submitted to

interventionsAll manuscripts followed usual journal practice for peer review, but those in the intervention group had an additional (LIS) peer reviewer invited.

main outcome measuresThe primary outcomes are the differences in first revision manuscripts between intervention and control groups in the quality of reporting and risk of bias. Quality of reporting was measured using four prespecified PRISMA-S items. Risk of bias was measured using ROBIS Domain 2. Assessments were done in duplicate and assessors were blinded to group allocation. Secondary outcomes included differences between groups for each individual PRISMA-S and ROBIS Domain 2 item. The difference in the proportion of manuscripts rejected as the first decision post-peer review between the intervention and control groups was an additional outcome.

resultsDifferences in the proportion of adequately reported searches (4.4% difference, 95% CI: -2.0% to 10.7%) and risk of bias in searches (0.5% difference, 95% CI: -13.7% to 14.6%) showed no statistically significant differences between groups. By 4 months post-study, 98 intervention and 70 control group manuscripts had been rejected after peer review (13.8% difference, 95% CI: 3.9% to 23.8%).

conclusionsInviting LIS peer reviewers did not impact adequate reporting or risk of bias of searches in first revision manuscripts of biomedical systematic reviews and related review types, though LIS peer reviewers may have contributed to a higher rate of rejection after peer review. TRIAL REGISTRATION NUMBER: Open Science Framework: https://doi.org/10.17605/OSF.IO/W4CK2.

Indexed as

LibrariansPeer ReviewPeer Review, ResearchSystematic Reviews as TopicHumansInformation management

Identifiers

PMID40074237
PMCPMC12320611

What Socratic holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.