Evidence mapPaperPMID 37587521Full record

Trial reportTrials2023

What is the role of randomised trials in implementation science?

Robbie Foy, Noah M Ivers, Jeremy M Grimshaw, Paul M Wilson

Registry-linked trialOpen access · goldAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Trials, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07166653 (Nordic Digital Health Education as an Implementation Tool for Hospital-at-home - Protocol for a Multicenter Randomized Controlled Trial), which is not on this map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
5.2field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07166653 narecruitingnot on this mapstarted 2025, after this paper: background citation

Nordic Digital Health Education as an Implementation Tool for Hospital-at-home - Protocol for a Multicenter Randomized Controlled Trial

TypeinterventionalSponsorNordsjaellands HospitalRan2025 to 2026Enrolled14ConditionsHospitalArmsHaH education
3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it, 12 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 4 institutions in 2 countries.

Robbie FoyLeeds Institute of Health Sciences, University of Leeds, Leeds, UK. r.foy@leeds.ac.uk.ORCID http://orcid.org/0000-0003-0605-7713
Noah M IversWomen's College Hospital, Department of Family and Community Medicine, University of Toronto, Toronto, Canada.
Jeremy M GrimshawOttawa Hospital Research Institute, Ottawa, Canada.
Paul M WilsonCentre for Primary Care and Health Services Research, University of Manchester, Manchester, UK.
Manchester Academic Health Science Centre · GBOttawa Hospital · CAUniversity of Leeds · GBUniversity of Toronto · CA

Funding

National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care Yorkshire and Humber NIHR200166
6 · The paper itself

Abstract

backgroundThere is a consistent demand for implementation science to inform global efforts to close the gap between evidence and practice. Key evaluation questions for any given implementation strategy concern the assessment and understanding of effects. Randomised trials are generally accepted as offering the most trustworthy design for establishing effectiveness but may be underused in implementation science. MAIN BODY: There is a continuing debate about the primacy of the place of randomised trials in evaluating implementation strategies, especially given the evolution of more rigorous quasi-experimental designs. Further critiques of trials for implementation science highlight that they cannot provide 'real world' evidence, address urgent and important questions, explain complex interventions nor understand contextual influences. We respond to these critiques of trials and highlight opportunities to enhance their timeliness and relevance through innovative designs, embedding within large-scale improvement programmes and harnessing routine data. Our suggestions for optimising the conditions for randomised trials of implementation strategies include strengthening partnerships with policy-makers and clinical leaders to realise the long-term value of rigorous evaluation and accelerating ethical approvals and decluttering governance procedures for lower risk studies.

conclusionPolicy-makers and researchers should avoid prematurely discarding trial designs when evaluating implementation strategies and work to enhance the conditions for their conduct.

Indexed as

Administrative PersonnelImplementation ScienceHumansResearch DesignResearch PersonnelCluster randomised controlled trialsImplementation scienceQuality improvement

Identifiers

PMID37587521
PMCPMC10428627
OpenAlexW4385876820

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.