Evidence map›Paper›PMID 40281735›Full record

ArticleBioengineering (Basel, Switzerland)2025

What Is the Role of Explainability in Medical Artificial Intelligence? A Case-Based Approach.

Elisabeth Hildt

Abstract read
In one paragraph

Article in Bioengineering (Basel, Switzerland), 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Review
  6. Moral diversity and the challenge of responsibility in AI-CDSS.Philosophy, ethics, and humanities in medicine : PEHM · 2026
    Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
  12. Review
  13. Review
  14. The Right to Understand in Health Care AI.Journal of medical Internet research · 2026
    Article
  15. Article
  16. Review
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

1 author.

Elisabeth HildtCenter for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago, IL 60616, USA.ORCID 0000-0003-1314-5527

Funding

German Federal Ministry of Education and Research (BMBF) 01DD20003
6 · The paper itself

Abstract

This article reflects on explainability in the context of medical artificial intelligence (AI) applications, focusing on AI-based clinical decision support systems (CDSS). After introducing the concept of explainability in AI and providing a short overview of AI-based clinical decision support systems (CDSSs) and the role of explainability in CDSSs, four use cases of AI-based CDSSs will be presented. The examples were chosen to highlight different types of AI-based CDSSs as well as different types of explanations: a machine language (ML) tool that lacks explainability; an approach with post hoc explanations; a hybrid model that provides medical knowledge-based explanations; and a causal model that involves complex moral concepts. Then, the role, relevance, and implications of explainability in the context of the use cases will be discussed, focusing on seven explainability-related aspects and themes. These are: (1) The addressees of explainability in medical AI; (2) the relevance of explainability for medical decision making; (3) the type of explanation provided; (4) the (often-cited) conflict between explainability and accuracy; (5) epistemic authority and automation bias; (6) Individual preferences and values; (7) patient autonomy and doctor-patient relationships. The case-based discussion reveals that the role and relevance of explainability in AI-based CDSSs varies considerably depending on the tool and use context. While it is plausible to assume that explainability in medical AI has positive implications, empirical data on explainability and explainability-related implications is scarce. Use-case-based studies are needed to investigate not only the technical aspects of explainability but also the perspectives of clinicians and patients on the relevance of explainability and its implications.

Indexed as

artificial intelligence (AI)automation biasautonomyclinical decision support system (CDSS)doctor–patient relationshipethicsexplainable AIinformed consentmachine learningmedical decision making

Identifiers

PMID40281735
PMCPMC12025101

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.