Evidence map›Paper›PMID 40536945›Full record

ArticleJournal of medical Internet research2025

The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study.

Calvin Howard, Amy Johnson, Joseph Peedicail, Marcus C Ng

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Calvin HowardDepartment of Neurology, Brigham and Women's Hospital, Harvard Medical School, 60 Fenwood Road 1st Floor, Boston, MA, 02115, United States.ORCID http://orcid.org/0000-0001-5576-9608
Amy JohnsonSection of Neurology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.ORCID http://orcid.org/0009-0003-0435-0243
Joseph PeedicailSection of Neurology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.ORCID http://orcid.org/0000-0002-9630-4994
Marcus C NgSection of Neurology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.ORCID http://orcid.org/0000-0002-6258-5943

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: The rising prevalence of dementia necessitates a scalable solution to cognitive screening. Paper-based cognitive screening examinations are well-validated but minimally scalable. If a digital cognitive screening examination could replicate paper-based screening, it may improve scalability while potentially maintaining the performance of these well-validated paper-based tests. Here, we evaluate the Rapid Online Cognitive Assessment (RoCA), a remote and self-administered digital cognitive screening examination. Objective: The objective of this study was to validate the ability of RoCA to reliably evaluate patient input, identify patients with cognitive impairment relative to the established tests, and evaluate its potential as a screening tool. Methods: RoCA uses a convolutional neural network to evaluate a patient's ability to perform common cognitive screening tasks: wireframe diagram copying and clock drawing tests. To evaluate RoCA, we compared its evaluations with those of established paper-based tests. This open-label study consists of 46 patients (age range 33-82 years) who were enrolled from neurology clinics. Patients completed the RoCA screening examination and either Addenbrooke's Cognitive Examination-3 (ACE-3, n=35) or Montreal Cognitive Assessment (MoCA, n=11). We evaluated 3 primary metrics of RoCA's performance: (1) ability to correctly evaluate patient inputs, (2) ability to identify patients with cognitive impairment compared to ACE-3 and MoCA, and (3) performance as a screening tool. Results: RoCA classifies patients similarly to gold standard paper-based tests, with a receiver operating characteristic area under the curve of 0.81 (95% CI 0.67-0.91; P<.001). RoCA achieved sensitivity of 0.94 (95% CI 0.80-1.0; P<.001). This was robust to multiple control analyses. Approximately 83% (16/19) of the patient respondents reported RoCA as highly intuitive, with 95% (18/19) perceiving it as adding value to their care. Conclusions: RoCA may act as a simple and highly scalable digital cognitive screening examination. However, due to the limitations of this study, further work is required to evaluate the ability of RoCA to be generalizable across patient populations, assess its performance in an entirely remote manner, and analyze the effect of digital literacy.

Indexed as

InternetNeurocognitive DisordersAdultAgedAged, 80 and overCognitive DysfunctionFemaleHumansMaleMiddle AgedNeural Networks, ComputerNeuropsychological Testsartificial intelligenceassessmentcognitioncognitivecognitive assessmentcognitive examinationcohortdementiageriatricsneurologyonline assessmentRapid Online Cognitive Assessmentremote screeningRoCAscreening

Identifiers

PMID40536945
PMCPMC12204636

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.