ArticleNeuroImage2022
Reliability and stability challenges in ABCD task fMRI data.
Article in NeuroImage, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 69 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
69 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Better together: A systematic review of studies combining magnetic resonance imaging with ecological momentary assessment.Social neuroscience · 2024Pooled it
- Parameter Space and Potential for Biomarker Development in 25 Years of fMRI Drug Cue Reactivity: A Systematic Review.JAMA psychiatry · 2024Pooled it
- Rumination induction task in fMRI: Effects of rumination focused cognitive behavioral therapy and stability in youth.Journal of affective disorders · 2025Trial
- Connectome-based substrates of emotional N-back performance in the adolescent brain cognitive development study.Developmental cognitive neuroscience · 2026Article
- Effects of working memory and reward reactivity on externalizing behaviors in the ABCD study.Developmental cognitive neuroscience · 2026Article
- The longitudinal structure of cognition in the ABCD study and associations with neural function and psychopathology: A Bayesian probabilistic principal components analysis.Developmental cognitive neuroscience · 2026Article
- Brainwide Structural Markers of Familial and Clinical Risk for Bipolar Disorder in Youth.Biological psychiatry. Cognitive neuroscience and neuroimaging · 2026Article
- Task and Resting-State Functional Magnetic Resonance Imaging Modeling of Brain-Behavior Relationships in Developmental Cohorts.Biological psychiatry · 2026Review
- Dense longitudinal neuroimaging reveals individual brain change trajectories.Trends in cognitive sciences · 2026Review
- Frontal-limbic mediated implicit cognitive control of emotion in the transition to adolescence.Cognitive, affective & behavioral neuroscience · 2026Article
- Multimodal correlates of socioemotional movie-watching and their associations with internalizing symptoms in childhood and adulthood.Social cognitive and affective neuroscience · 2026Article
- The Philadelphia Theta Burst Project: A novel fMRI-guided electric field modeling dataset with reliability metrics.Imaging neuroscience (Cambridge, Mass.) · 2026Article
- Within-person imbalance of reward sensitivity and executive functioning across adolescent development: A longitudinal examination of the dual systems model from childhood to adulthood.Developmental psychology · 2025Article
- Translating neurophysiological biomarkers into clinical tools: A psychometric blueprint illustrated with the error-related negativity.The American psychologist · 2025Review
- Article
- Article
- Transdiagnostic Symptom Domains Have Distinct Patterns of Association With Head Motion During Multimodal Imaging in Children.Biological psychiatry global open science · 2025Article
- Associations of neighborhood threat and deprivation with psychopathology: Uncovering neural mechanisms.Development and psychopathology · 2025Article
- Investigative Approaches to Resilient Emotion Regulation Neurodevelopment in a South African Birth Cohort.Biological psychiatry global open science · 2025Article
- Reliability of Brain Activity During a Supine Bilateral Leg Press and Association With Concurrent 3D Knee Joint Biomechanics.The European journal of neuroscience · 2025Article
9 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
Abstract
Trait stability of measures is an essential requirement for individual differences research. Functional MRI has been increasingly used in studies that rely on the assumption of trait stability, such as attempts to relate task related brain activation to individual differences in behavior and psychopathology. However, recent research using adult samples has questioned the trait stability of task-fMRI measures, as assessed by test-retest correlations. To date, little is known about trait stability of task fMRI in children. Here, we examined within-session reliability and long-term stability of individual differences in task-fMRI measures using fMRI measures of brain activation provided by the adolescent brain cognitive development (ABCD) Study Release v4.0 as an individual's average regional activity, using its tasks focused on reward processing, response inhibition, and working memory. We also evaluated the effects of factors potentially affecting reliability and stability. Reliability and stability (quantified as the ratio of non-scanner related stable variance to all variances) was poor in virtually all brain regions, with an average value of 0.088 and 0.072 for short term (within-session) reliability and long-term (between-session) stability, respectively, in regions of interest (ROIs) historically-recruited by the tasks. Only one reliability or stability value in ROIs exceeded the 'poor' cut-off of 0.4, and in fact rarely exceeded 0.2 (only 4.9%). Motion had a pronounced effect on estimated reliability/stability, with the lowest motion quartile of participants having a mean reliability/stability 2.5 times higher (albeit still 'poor') than the highest motion quartile. Poor reliability and stability of task-fMRI, particularly in children, diminishes potential utility of fMRI data due to a drastic reduction of effect sizes and, consequently, statistical power for the detection of brain-behavior associations. This essential issue urgently needs to be addressed through optimization of task design, scanning parameters, data acquisition protocols, preprocessing pipelines, and data denoising methods.
Indexed as
Identifiers
What Socratic holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.