Evidence map›Paper›PMID 31834408›Full record

ArticleRheumatology (Oxford, England)2020

Methodological considerations when analysing and interpreting real-world data.

Til Stürmer, Tiansheng Wang, Yvonne M Golightly, Alex Keil, Jennifer L Lund, Michele Jonsson Funk

Abstract read
In one paragraph

Article in Rheumatology (Oxford, England), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Silent Pain or Silent Records? Pain Visibility, Documentation Ethics, and Nursing Management in Neurocritical Care.Nursing philosophy : an international journal for healthcare professionals · 2026
    Article
  8. Article
  9. Article
  10. Observational
  11. Article
  12. Article
  13. Review
  14. Target Trial Emulation to Incorporate Real-World Data in the Estimation of the Clinical and Cost-Effectiveness of Biologic Treatment.Medical decision making : an international journal of the Society for Medical Decision Making · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. APPRAISE: A Tool for Appraising Potential for Bias in Real-World Evidence Studies on Medication Effectiveness or Safety.Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research · 2025
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Til StürmerDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Tiansheng WangDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Yvonne M GolightlyDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Alex KeilDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Jennifer L LundDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Michele Jonsson FunkDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.

Funding

Re-Entry Supplement: Investigation of Oral Microbial Enzymes for the Detection and Treatment of Periodontal DiseaseUL1TR002489 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BUSE, JOHN BERNARD, SHAHEEN, NICHOLAS J · 2018 to 2022
$48.6M
Propensity scores and preventive drug use in the elderlyR01AG056479 · NIA · UNIV OF NORTH CAROLINA CHAPEL HILL · PI Til Sturmer · 2017 to 2026
$5.0M
Methods for Estimating Sex Differences in Safety and Effectiveness of DrugsR01HL118255 · NHLBI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI JONSSON FUNK, MICHELE LAURA · 2014 to 2017
$1.7M
PROMIS Validation in Prospective Population-based Prostate Cancer Research StudyR01CA174453 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI CHEN, RONALD, REEVE, BRYCE B · 2012 to 2016
$1.4M
Patterns of use, comparative effectiveness, and safety of rotavirus vaccinesR21HD080214 · NICHD · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BROOKHART, MAURICE ALAN · 2014 to 2015
$413k
NCATS NIH HHS UL1 TR002489NCI NIH HHS R01 CA174453NHLBI NIH HHS R01 HL118255NIA NIH HHS R01 AG056479NICHD NIH HHS R21 HD080214
6 · The paper itself

Abstract

In the absence of relevant data from randomized trials, nonexperimental studies are needed to estimate treatment effects on clinically meaningful outcomes. State-of-the-art study design is imperative for minimizing the potential for bias when using large healthcare databases (e.g. claims data, electronic health records, and product/disease registries). Critical design elements include new-users (begin follow-up at treatment initiation) reflecting hypothetical interventions and clear timelines, active-comparators (comparing treatment alternatives for the same indication), and consideration of induction and latent periods. Propensity scores can be used to balance measured covariates between treatment regimens and thus control for measured confounding. Immortal-time bias can be avoided by defining initiation of therapy and follow-up consistently between treatment groups. The aim of this manuscript is to provide a non-technical overview of study design issues and solutions and to highlight the importance of study design to minimize bias in nonexperimental studies using real-world data.

Indexed as

Data Interpretation, StatisticalRheumatologyDatabases, FactualHumansPragmatic Clinical Trials as TopicPropensity ScoreResearch Designactive-comparatorcohort studiesdata analysismethodologymissing datanew-userpropensity scorereal-world datareal-world evidencestudy design

Identifiers

PMID31834408
PMCPMC6909905

What Socratic holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.