Evidence map›Paper›PMID 40737617›Full record

ArticleJMIR human factors2025

Leveraging Dual Usability Methods to Evaluate Clinical Decision Support Among Patients With Traumatic Brain Injury: Mixed Methods Study.

Rubina F Rizvi, Sameen Faisal, Mark Sussman, Patricia Mendlick, Sam Brown, Elizabeth Lindemann, Sean Switzer, Genevieve B Melton, Christopher J Tignanelli

Abstract read
In one paragraph

Article in JMIR human factors, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Rubina F RizviDepartment of Surgery, University of Minnesota, 420 Delaware Street South East, Mayo Mail Code 195, Minneapolis, MN, 55455, United States, 1 612-626-1999.ORCID 0000-0001-9432-3086
Sameen FaisalCollege of Biological Sciences, University of Minnesota, Minneapolis, MN, United States.ORCID 0009-0006-6620-4956
Mark SussmanStanson Premier Inc, Charlotte, NC, United States.ORCID 0009-0000-6312-0497
Patricia MendlickFairview Health Services, Minneapolis, MN, United States.ORCID 0009-0007-3768-7159
Sam BrownFairview Health Services, Minneapolis, MN, United States.ORCID 0009-0002-8614-0874
Elizabeth LindemannCenter For Learning Health System Sciences, University of Minnesota, Minneapolis, MN, United States.ORCID 0009-0000-1027-3537
Sean SwitzerFairview Health Services, Minneapolis, MN, United States.ORCID 0000-0002-7018-5261
Genevieve B MeltonDepartment of Surgery, University of Minnesota, 420 Delaware Street South East, Mayo Mail Code 195, Minneapolis, MN, 55455, United States, 1 612-626-1999.ORCID 0000-0001-5193-1663
Christopher J TignanelliDepartment of Surgery, University of Minnesota, 420 Delaware Street South East, Mayo Mail Code 195, Minneapolis, MN, 55455, United States, 1 612-626-1999.ORCID 0000-0002-8079-5565

Funding

University of Minnesota Clinical and Translational Science Institute (UMN CTSI)UM1TR004405 · NCATS · UNIVERSITY OF MINNESOTA · PI Bruce R Blazar, Damien A Fair · 2023 to 2026
$30.8M
TRAINING-PULMONARY CELL &MOLECULAR BIOLOGY &PHYSIOLOGYT32HL007741 · NHLBI · UNIVERSITY OF MINNESOTA TWIN CITIES · PI DUDLEY, R. ADAMS, INGBAR, DAVID H · 1994 to 2023
$13.9M
CTSA K12 Program at University of MinnesotaK12TR004373 · NCATS · UNIVERSITY OF MINNESOTA · PI David H Ingbar · 2024 to 2026
$3.2M
AHRQ HHS P30 HS029744AHRQ HHS R18 HS028583NCATS NIH HHS K12 TR004373NCATS NIH HHS UM1 TR004405NHLBI NIH HHS T32 HL007741
6 · The paper itself

Abstract

Background: Patients with traumatic brain injury are at an increased risk of developing venous thromboembolism. Clinical decision support systems (CDSSs) may improve the use of venous thromboembolism prophylaxis protocols, yet suffer from poor compliance among end users due to a lack of user-centered design. Objective: The objective of this work was to improve the content, design, and workflow integration of a traumatic brain injury-CDSS based on feedback from experts and end users. Methods: The CDSS was evaluated leveraging a dual usability approach. A set of usability experts (n=3) and trauma providers (n=5) performed heuristic evaluations and usability testing by end users. Data was collected through a triangulation of methods and analyzed using qualitative (thematic) and quantitative (descriptive) analyses. Results: Among the 145 total issues identified across both methods, 66 issues were found to be unique. Of the 66, a total of 17 issues were found by heuristic evaluations, 43 by usability testing by end users, and 6 were found across both methods. Thematic analysis was conducted on the 66 unique issues, which were further assigned to themes and subsequent subthemes. We identified 13 unique themes. The 3 most prevalent themes of 66 issues were lack of supporting evidence (n=17, 26%), operational barriers arising from the test environment (n=11, 17%), formatting inconsistencies, and lack of following standards (n=8, 12%). The system's usability scale survey score was 77.5 (SD 16, 95% CI 57.6-97.4), interpreted as an acceptable or good usability range. The mean response score for Single Ease Questions for all tasks was 5.9 (SD 0.53). Conclusions: Combining expert and end user-driven usability evaluation methods identified a more comprehensive list of issues. This can facilitate the optimization of the traumatic brain injury-CDSS, resulting in improved usability and care management.

Indexed as

Brain Injuries, TraumaticDecision Support Systems, ClinicalUser-Centered DesignVenous ThromboembolismHumansclinical decision support system (CDSS)decision support systemend user–based usability testingheuristic evaluationstraumatic brain injuryvenous thromboembolism

Identifiers

PMID40737617
PMCPMC12310145

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.