Evidence mapPaperPMID 39806706Full record

ArticleBMJ open2024

Cross-sectional evaluation of medical reversals among National Institute of Health guideline practices implemented during the COVID-19 pandemic: how often did experts err in a time of crisis?

Alec J Kacew, Alyson Haslam, Vinay Prasad, Adam S Cifu

Abstract read
In one paragraph

Article in BMJ open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Alec J KacewUniversity of Pennsylvania, Philadelphia, Pennsylvania, USA.
Alyson HaslamDepartment of Epidemiology and Biostatistics, University of California, San Francisco, California, USA alyson.haslam@ucsf.edu vinayak.prasad@ucsf.edu.ORCID 0000-0002-7876-3978
Vinay PrasadDepartment of Medicine, University of California, San Francisco, California, USA alyson.haslam@ucsf.edu vinayak.prasad@ucsf.edu.
Adam S CifuDepartment of Medicine, The University of Chicago, Chicago, Illinois, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe COVID-19 pandemic required the rapid and often widespread implementation of medical practices without robust data. Many of these practices have since been tested in large, randomised trials and were found to be in error. We sought to identify incorrect recommendations, or reversals, among National Institute of Health COVID-19 guidelines and Food and Drug Administration (FDA) approvals and authorisations.

designRetrospective cross-sectional study.

participantsRecommended medical practices and FDA authorisations or approvals for COVID-19 prevention, treatment and/or management.

main outcome measuresThe frequency and characteristics of COVID-19 medical reversals, defined as practices that were implemented and/or recommended during the pandemic, but were later tested in randomised trials that failed to find benefit.

resultsWe found 332 COVID-19 recommendations. 85 (25.6%) opposed a medical practice, 23 (6.9%) were to continue a pre-COVID standard of care without deviation and 224 (67.5%) reccommended a new medical practice. We found randomised trials assessing 72 of these practices (32.1%), among which 25 (35%) were found to be in error and deemed medical reversals. Among medical reversals, 21 (84%) were prescription medications and 1 (4%) was convalescent plasma. 17 (68%) were repurposed medications. Two (8%) were procedures or mechanical interventions and one (4%) was a device. 16 (64%) reversals pertained to the hospital setting (4 to intensive care units), 4 (16%) were non-specific (ie, applicable to any setting), 4 (16%) pertained to a non-hospital setting and 1 pertained to healthcare workers.

conclusionWhen faced with a novel pandemic, policymakers rapidly made hundreds of specific medical recommendations. More than two out of three were never robustly tested. Among practices tested in a randomised fashion, one in three was made in error. Pandemic recommendation errors were substantial. Early and coordinated efforts to initiate randomised trials, even during dire situations, may mitigate the perpetuation of ineffective practices.

Indexed as

COVID-19COVID-19 Drug TreatmentGuideline AdherencePractice Guidelines as TopicCross-Sectional StudiesHumansPandemicsRandomized Controlled Trials as TopicRetrospective StudiesSARS-CoV-2United StatesUnited States Food and Drug AdministrationCOVID-19Health policyPublic health

Identifiers

PMID39806706
PMCPMC11667299

What Socratic holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.