Evidence map›Paper›PMID 35871898›Full record

ArticleBritish journal of anaesthesia2022

Trials with 'non-significant' results are not insignificant trials: a common significance threshold distorts reporting and interpretation of trial results.

Emily A Vail, Michael S Avidan

Abstract readEditorialComment
PubMed Publisher
In one paragraph

Article in British journal of anaesthesia, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Fooled by Significance Testing: An Analysis of the LOVIT Vitamin C Trial.The journal of extra-corporeal technology · 2022
    Article
  6. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

2 authors.

Emily A VailDepartment of Anesthesiology and Critical Care, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA. Electronic address: emily.vail@pennmedicine.upenn.edu.
Michael S AvidanDepartment of Anesthesiology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

We discuss a newly published study examining how phrases are used in clinical trials to describe results when the estimated P-value is close to (slightly above or slightly below) 0.05, which has been arbitrarily designated by convention as the boundary for 'statistical significance'. Terms such as 'marginally significant', 'trending towards significant', and 'nominally significant' are well represented in biomedical literature, but are not actually scientifically meaningful. Acknowledging that 'statistical significance' remains a major determinant of publication, we propose that scientific journals de-emphasise the use of P-values for null hypothesis significance testing, a purpose for which they were never intended, and avoid the use of these ambiguous and confusing terms in scientific articles. Instead, investigators could simply report their findings: effect sizes, P-values, and confidence intervals (or their Bayesian equivalents), and leave it to the discerning reader to infer the clinical applicability and importance. Our goal should be to move away from describing studies (or trials) as positive or negative based on an arbitrary P-value threshold, and rather to judge whether the scientific evidence provided is informative or uninformative.

Indexed as

Research DesignBayes TheoremHumansbiostatisticsclinical researchevidence-based medicinemedical literatureprobability

Identifiers

What Socratic holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.