Evidence map›Paper›PMID 31488200›Full record

ArticleTrials2019

Opportunities for selective reporting of harms in randomized clinical trials: Selection criteria for non-systematic adverse events.

Evan Mayo-Wilson, Nicole Fusco, Hwanhee Hong, Tianjing Li, Joseph K Canner, Kay Dickersin

Open access · goldAbstract read
In one paragraph

Article in Trials, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 4 pooled it
3.3field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 4 syntheses or guidelines pooled it, 35 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Individual participant data meta-analysis versus aggregate data meta-analysis: A case study in eczema and food allergy prevention.Clinical and experimental allergy : journal of the British Society for Allergy and Clinical Immunology · 2022
    Pooled it
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Observational
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Evan Mayo-WilsonDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, 1025 E 7th St, #179D, Bloomington, IN, 47405, USA. emayowil@iu.edu.ORCID http://orcid.org/0000-0001-6126-2459
Nicole FuscoDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, 1025 E 7th St, #179D, Bloomington, IN, 47405, USA.
Hwanhee HongDepartment of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N Broadway, Hampton House, Baltimore, MD, 21205, USA.
Tianjing LiDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, 1025 E 7th St, #179D, Bloomington, IN, 47405, USA.
Joseph K CannerDepartment of Surgery, Johns Hopkins School of Medicine, 600 North Wolfe Street, Blalock 1202, Baltimore, MD, 21287, USA.
Kay DickersinDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, 1025 E 7th St, #179D, Bloomington, IN, 47405, USA.
Indiana University Bloomington · USJohns Hopkins University · US

Funding

Patient-Centered Outcomes Research Institute ME 1303 5785
6 · The paper itself

Abstract

backgroundAdverse events (AEs) in clinical trials may be reported in multiple sources. Different methods for reporting adverse events across trials or across sources for a single trial may produce inconsistent information about the adverse events associated with interventions.

methodsWe compared the methods authors use to decide which AEs to include in a particular source (i.e., "selection criteria"), including the number of different types of AEs reported (i.e., rather than the number of events). We compared sources (e.g., journal articles, clinical study reports (CSRs)) of trials for two drug-indications-gabapentin for neuropathic pain and quetiapine for bipolar depression. Electronic searches were completed in 2015. We identified selection criteria and assessed how criteria affected AE reporting.

resultsWe identified 21 gabapentin and 7 quetiapine trials. We found 6 gabapentin CSRs and 2 quetiapine CSRs, all written by drug manufacturers. All CSRs reported all AEs without applying selection criteria; by comparison, no other source reported all AEs, and 15/68 (22%) gabapentin sources and 19/48 (40%) quetiapine sources reported using selection criteria. Selection criteria greatly affected the number of AEs reported. For example, 67/316 (21%) AEs in one quetiapine trial met the criterion "occurring in ≥2% of participants in any treatment group," while only 5/316 (2%) AEs met the criterion "occurring in ≥10% of quetiapine-treated patients and twice as frequent in the quetiapine group as the placebo group."

conclusionsSelection criteria for reporting AEs vary across trials and across sources for individual trials. If investigators do not pre-specify selection criteria, they might "cherry-pick" AEs based on results. Even if investigators pre-specify selection criteria, selective reporting will produce biased meta-analyses and clinical practice guidelines. Data about all AEs identified in clinical trials should be publicly available; however, sharing data will not solve all the problems identified in this study.

Indexed as

Adverse Drug Reaction Reporting SystemsRandomized Controlled Trials as TopicResearch ReportBipolar DisorderGabapentinHumansInformation DisseminationNeuralgiaQuetiapine FumarateGabapentinQuetiapine FumarateAdverse eventsClinical trialsData sharingHarmsReporting biasSelective outcome reportingTrial registration

Identifiers

PMID31488200
PMCPMC6728982
OpenAlexW2972281968

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.