Evidence map›Paper›PMID 34555021›Full record

ArticlePLoS biology2021

Leveraging vibration of effects analysis for robust discovery in observational biomedical data science.

Braden T Tierney, Elizabeth Anderson, Yingxuan Tan, Kajal Claypool, Sivateja Tangirala, Aleksandar D Kostic, Arjun K Manrai, Chirag J Patel

Abstract read
In one paragraph

Article in PLoS biology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Evidence triangulation in health research.European journal of epidemiology · 2025
    Article
  6. Article
  7. What is the vibration of effects?BMJ evidence-based medicine · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Braden T TierneyDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.
Elizabeth AndersonDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.
Yingxuan TanDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.ORCID 0000-0001-6674-3219
Kajal ClaypoolDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.
Sivateja TangiralaDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.ORCID 0000-0003-0305-471X
Aleksandar D KosticSection on Pathophysiology and Molecular Pharmacology, Joslin Diabetes Center, Boston, Massachusetts, United States of America.ORCID 0000-0002-0837-4360
Arjun K ManraiDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.
Chirag J PatelDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America.ORCID 0000-0002-8756-8525

Funding

SPECIAL ASSAY COREP30DK036836 · NIDDK · JOSLIN DIABETES CENTER · PI ROHIT N. KULKARNI · 1986 to 2026
$50.5M
Data science tools to identify robust exposure-phenotype associations for precision medicineR01ES032470 · NIEHS · HARVARD MEDICAL SCHOOL · PI MANRAI, ARJUN KUMAR, PATEL, CHIRAG J. · 2021 to 2025
$3.5M
Big Data Analysis of HIV Risk and Epidemiology in Sub-Saharan AfricaR01AI127250 · NIAID · STANFORD UNIVERSITY · PI BENDAVID, ERAN, PATEL, CHIRAG J. · 2017 to 2020
$2.7M
Harvard Training Program in Bioinformatics Applied to Diabetes, Obesity and Metabolism.T32DK110919 · NIDDK · MASSACHUSETTS GENERAL HOSPITAL · PI FLOREZ, JOSE CARLOS, PATEL, CHIRAG J. · 2017 to 2021
$1.3M
NIAID NIH HHS R01 AI127250NIDDK NIH HHS P30 DK036836NIDDK NIH HHS T32 DK110919NIEHS NIH HHS R01 ES032470
6 · The paper itself

Abstract

Hypothesis generation in observational, biomedical data science often starts with computing an association or identifying the statistical relationship between a dependent and an independent variable. However, the outcome of this process depends fundamentally on modeling strategy, with differing strategies generating what can be called "vibration of effects" (VoE). VoE is defined by variation in associations that often lead to contradictory results. Here, we present a computational tool capable of modeling VoE in biomedical data by fitting millions of different models and comparing their output. We execute a VoE analysis on a series of widely reported associations (e.g., carrot intake associated with eyesight) with an extended additional focus on lifestyle exposures (e.g., physical activity) and components of the Framingham Risk Score for cardiovascular health (e.g., blood pressure). We leveraged our tool for potential confounder identification, investigating what adjusting variables are responsible for conflicting models. We propose modeling VoE as a critical step in navigating discovery in observational data, discerning robust associations, and cataloging adjusting variables that impact model output.

Indexed as

Models, StatisticalData ScienceEpidemiologic MethodsHumansObservational Studies as Topic

Identifiers

PMID34555021
PMCPMC8510627

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.