Evidence map›Paper›PMID 36997406›Full record

ReviewBiological psychiatry. Cognitive neuroscience and neuroimaging2023

From Classical Methods to Generative Models: Tackling the Unreliability of Neuroscientific Measures in Mental Health Research.

Nathaniel Haines, Holly Sullivan-Toole, Thomas Olino

Abstract readReview
In one paragraph

Review in Biological psychiatry. Cognitive neuroscience and neuroimaging, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Article
  2. Article
  3. Associations Between Steep Delay Discounting and Punishment Learning.Computational psychiatry (Cambridge, Mass.) · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Test-retest reliability of the play-or-pass version of the Iowa Gambling Task.Cognitive, affective & behavioral neuroscience · 2024
    Article
  13. Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Nathaniel HainesDepartment of Data Science, Bayesian Beginnings LLC, Columbus, Ohio. Electronic address: nathaniel.b.haines@gmail.com.
Holly Sullivan-TooleDepartment of Psychology, Temple University, Philadelphia, Pennsylvania.
Thomas OlinoDepartment of Psychology, Temple University, Philadelphia, Pennsylvania.

Funding

Enhancing evaluation of reward learning using computational modeling methodsR21MH130792 · NIMH · TEMPLE UNIV OF THE COMMONWEALTH · PI OLINO, THOMAS M · 2022 to 2023
$427k
Behavioral and neural mechanisms of reward responsivity across normative and at-risk adolescent developmentF32MH127948 · NIMH · TEMPLE UNIV OF THE COMMONWEALTH · PI SULLIVAN-TOOLE, HOLLY · 2021 to 2023
$205k
NIMH NIH HHS F32 MH127948NIMH NIH HHS R21 MH130792
6 · The paper itself

Abstract

Advances in computational statistics and corresponding shifts in funding initiatives over the past few decades have led to a proliferation of neuroscientific measures being developed in the context of mental health research. Although such measures have undoubtedly deepened our understanding of neural mechanisms underlying cognitive, affective, and behavioral processes associated with various mental health conditions, the clinical utility of such measures remains underwhelming. Recent commentaries point toward the poor reliability of neuroscientific measures to partially explain this lack of clinical translation. Here, we provide a concise theoretical overview of how unreliability impedes clinical translation of neuroscientific measures; discuss how various modeling principles, including those from hierarchical and structural equation modeling frameworks, can help to improve reliability; and demonstrate how to combine principles of hierarchical and structural modeling within the generative modeling framework to achieve more reliable, generalizable measures of brain-behavior relationships for use in mental health research.

Indexed as

Mental DisordersMental HealthBrainHumansReproducibility of ResultsBayesian analysisClinical assessmentGenerative modelingMeasurement errorNeuroscientific measuresReliability paradox

Identifiers

PMID36997406
PMCPMC10333448

What Socratic holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.