Evidence map›Paper›PMID 36442004›Full record

ArticleNeuropsychology2023

Measurement fidelity of clinical assessment methods in a global study on identifying reproducible brain signatures of obsessive-compulsive disorder.

Roseli G Shavitt, Karthik Sheshachala, Dianne M Hezel, Melanie M Wall, Srinivas Balachander, Christine Lochner, Janardhanan C Narayanaswamy, Daniel L C Costa, Maria Alice de Mathis, Anton J L M van Balkom and 7 more

Open access · hybridAbstract read
In one paragraph

Article in Neuropsychology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
0.4field-weighted citation impact, top 36% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 2 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors at 6 institutions in 5 countries.

Roseli G ShavittObsessive-Compulsive Spectrum Disorders Program (PROTOC-IPq-HCFMUSP), Instituto de Psiquiatria, Hospital das Clinicas, Faculdade de Medicina, Universidade de Sao Paulo.
Karthik SheshachalaObsessive-Compulsive Disorder Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences.
Dianne M HezelColumbia University Irving Medical Center, Columbia University.
Melanie M WallColumbia University Irving Medical Center, Columbia University.
Srinivas BalachanderObsessive-Compulsive Disorder Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences.
Christine LochnerSouth African Medical Research Council Unit on Risk and Resilience in Mental Disorders, Department of Psychiatry, Stellenbosch University.
Janardhanan C NarayanaswamyObsessive-Compulsive Disorder Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences.
Daniel L C CostaObsessive-Compulsive Spectrum Disorders Program (PROTOC-IPq-HCFMUSP), Instituto de Psiquiatria, Hospital das Clinicas, Faculdade de Medicina, Universidade de Sao Paulo.
Maria Alice de MathisObsessive-Compulsive Spectrum Disorders Program (PROTOC-IPq-HCFMUSP), Instituto de Psiquiatria, Hospital das Clinicas, Faculdade de Medicina, Universidade de Sao Paulo.
Anton J L M van BalkomAmsterdam University Medical Center, Vrije Universiteit, Amsterdam Public Health Research Institute.
Niels T de JoodeDepartment of Psychiatry, Amsterdam University Medical Center, Vrije Universiteit Amsterdam.
Madhuri NarayanObsessive-Compulsive Disorder Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences.
Odile A van den HeuvelDepartment of Psychiatry, Amsterdam University Medical Center, Vrije Universiteit Amsterdam.
Dan J SteinSouth African Medical Research Council Unit on Risk and Resilience in Mental Disorders, Department of Psychiatry, University of Cape Town.ORCID 0000-0001-7218-7810
Euripedes C MiguelObsessive-Compulsive Spectrum Disorders Program (PROTOC-IPq-HCFMUSP), Instituto de Psiquiatria, Hospital das Clinicas, Faculdade de Medicina, Universidade de Sao Paulo.
Helen Blair SimpsonColumbia University Irving Medical Center, Columbia University.
Y C Janardhan ReddyObsessive-Compulsive Disorder Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences.ORCID 0000-0002-9925-9631
RELX Group (Netherlands) · NLHospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo · BRColumbia University Irving Medical Center · USSouth African Medical Research Council · ZAVrije Universiteit Amsterdam · NLAmsterdam University Medical Centers · NL

Funding

Identifying Reproducible Brain Signatures of Obsessive-Compulsive ProfilesR01MH113250 · NIMH · NEW YORK STATE PSYCHIATRIC INSTITUTE DBA RESEARCH FOUNDATION FOR MENTAL HYGIENE, INC · PI SIMPSON, HELEN BLAIR, WALL, MELANIE M · 2017 to 2021
$4.2M
National Institute of Mental HealthNIMH NIH HHS R01 MH113250
6 · The paper itself

Abstract

objectiveTo describe the steps of ensuring measurement fidelity of core clinical measures in a five-country study on brain signatures of obsessive-compulsive disorder (OCD).

methodWe collected data using standardized instruments, which included the Yale-Brown Obsessive-Compulsive Scale (YBOCS), the Dimensional YBOCS (DYBOCS), the Brown Assessment of Beliefs Scale (BABS), the 17-item Hamilton Depression Scale (HAM-D), the Hamilton Anxiety Scale (HAM-A), and the Structured Clinical Interview for DSM-5 (SCID). Steps to ensure measurement fidelity included translating instruments, developing a clinical decision manual, and continuing reliability training with 11-13 transcripts of each instrument by 13 independent evaluators across sites over 4 years. We use multigroup confirmatory factor analysis (MGCFA) to report interrater reliability (IRR) among the evaluators and factor structure for each scale in 206 participants with OCD.

resultsThe overall IRR for most scales was high (ICC > 0.94) and remained good to excellent throughout the study. Consistent factor structures (configural invariance) were found for all instruments across the sites, while similarity in the factor loadings for the items (metric invariance) could be established only for the DYBOCS and the BABS.

conclusionsIt is feasible to achieve measurement fidelity of clinical measures in multisite, multilinguistic global studies, despite the challenges inherent to such endeavors. Future studies should not only report IRR but also consider reporting methods of standardization of data collection and measurement invariance to identify factor structures of core clinical measures. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Indexed as

Obsessive-Compulsive DisorderBrainHumansPsychiatric Status Rating ScalesReproducibility of Results

Identifiers

PMID36442004
PMCPMC10073274
OpenAlexW4310089631

What Socratic holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.