Evidence map›Paper›PMID 37847666›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

Design of an interface to communicate artificial intelligence-based prognosis for patients with advanced solid tumors: a user-centered approach.

Catherine J Staes, Anna C Beck, George Chalkidis, Carolyn H Scheese, Teresa Taft, Jia-Wen Guo, Michael G Newman, Kensaku Kawamoto, Elizabeth A Sloss, Jordan P McPherson

Open access · hybridAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
0.6field-weighted citation impact, top 25% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 15 citations in OpenAlex.

  1. Article
  2. Review
  3. Using human factors methods to mitigate bias in artificial intelligence-based clinical decision support.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  4. Article
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 2 countries.

Catherine J StaesCollege of Nursing, University of Utah, Salt Lake City, UT 84112, United States.ORCID 0000-0002-5423-3251
Anna C BeckDepartment of Internal Medicine, Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, United States.
George ChalkidisHealthcare IT Research Department, Center for Digital Services, Hitachi Ltd., Tokyo, Japan.ORCID 0000-0003-4414-9010
Carolyn H ScheeseCollege of Nursing, University of Utah, Salt Lake City, UT 84112, United States.
Teresa TaftDepartment of Biomedical Informatics, School of Medicine, University of Utah, Salt Lake City, UT 84108, United States.ORCID 0000-0002-9158-7323
Jia-Wen GuoCollege of Nursing, University of Utah, Salt Lake City, UT 84112, United States.ORCID 0000-0002-4698-4696
Michael G NewmanDepartment of Population Sciences, Huntsman Cancer Institute, Salt Lake City, UT 84112, United States.ORCID 0000-0002-3147-6058
Kensaku KawamotoDepartment of Biomedical Informatics, School of Medicine, University of Utah, Salt Lake City, UT 84108, United States.ORCID 0000-0003-4282-9338
Elizabeth A SlossCollege of Nursing, University of Utah, Salt Lake City, UT 84112, United States.ORCID 0000-0003-2071-5495
Jordan P McPhersonDepartment of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, UT 84108, United States.ORCID 0000-0003-4038-7951
University of Utah · USHitachi (Japan) · JPHuntsman Cancer Institute · US

Funding

Interdisciplinary Training in Cancer, Caregiving and End-of-Life CareT32NR013456 · NINR · UNIVERSITY OF UTAH · PI ELLINGTON, LEE A, MOONEY, KATHLEEN H · 2013 to 2022
$3.4M
NINR NIH HHS T32 NR013456
6 · The paper itself

Abstract

objectivesTo design an interface to support communication of machine learning (ML)-based prognosis for patients with advanced solid tumors, incorporating oncologists' needs and feedback throughout design. MATERIALS AND

methodsUsing an interdisciplinary user-centered design approach, we performed 5 rounds of iterative design to refine an interface, involving expert review based on usability heuristics, input from a color-blind adult, and 13 individual semi-structured interviews with oncologists. Individual interviews included patient vignettes and a series of interfaces populated with representative patient data and predicted survival for each treatment decision point when a new line of therapy (LoT) was being considered. Ongoing feedback informed design decisions, and directed qualitative content analysis of interview transcripts was used to evaluate usability and identify enhancement requirements.

resultsDesign processes resulted in an interface with 7 sections, each addressing user-focused questions, supporting oncologists to "tell a story" as they discuss prognosis during a clinical encounter. The iteratively enhanced interface both triggered and reflected design decisions relevant when attempting to communicate ML-based prognosis, and exposed misassumptions. Clinicians requested enhancements that emphasized interpretability over explainability. Qualitative findings confirmed that previously identified issues were resolved and clarified necessary enhancements (eg, use months not days) and concerns about usability and trust (eg, address LoT received elsewhere). Appropriate use should be in the context of a conversation with an oncologist.

conclusionUser-centered design, ongoing clinical input, and a visualization to communicate ML-related outcomes are important elements for designing any decision support tool enabled by artificial intelligence, particularly when communicating prognosis risk.

Indexed as

Artificial IntelligenceNeoplasmsAdultHeuristicsHumansPrognosisartificial intelligenceclinical decision-makingdata visualizationneoplasms/mortalityprognosisuser-centered design

Identifiers

PMID37847666
PMCPMC10746322
OpenAlexW4387699742

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.