Evidence map›Paper›PMID 41549611›Full record

ArticleJournal of applied clinical medical physics2026

Multimodal deep learning for breast tumor classification: Integrating mammography and ultrasound for enhanced diagnostic accuracy.

Yu Yan, Yichen Xu, Ge Fang, Xu He, Yifei Qian, Wenwen Zhu

Abstract read
In one paragraph

Article in Journal of applied clinical medical physics, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yu YanDepartment of Medical Equipment, Jiangsu Province Hospital of Chinese Medicine, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.
Yichen XuSchool of Artificial Intelligence and Information Technology, Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.
Ge FangDepartment of Medical Equipment, Jiangsu Province Hospital of Chinese Medicine, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.
Xu HeDepartment of Medical Equipment, Jiangsu Province Hospital of Chinese Medicine, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.ORCID https://orcid.org/0000-0002-6983-9379
Yifei QianDepartment of Medical Equipment, Jiangsu Province Hospital of Chinese Medicine, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.
Wenwen ZhuSchool of Artificial Intelligence and Information Technology, Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China.

Funding

Postgraduate Research & Practice Innovation Program of Jiangsu Province KYCX24_2160
6 · The paper itself

Abstract

backgroundDeep learning has advanced breast tumor prediction research, but traditional single-modality models limit feature diversity and accuracy. PURPOSE: To develop and validate a multimodal deep learning approach that combines mammography and ultrasound imaging for improved breast tumor classification and enhanced clinical decision-making.

methodsThis retrospective study analyzed 663 female patients with breast lesions from 2018 to 2021, including 384 benign and 279 malignant cases. The two-stage prediction model employed improved modality-specific attention mechanisms: efficient channel attention (ECA-Net) for ultrasound and convolutional block attention module (CBAM) for mammography. The fused features were input into a stacking ensemble module with logistic regression (LR), support vector machine (SVM), random forest (RF), and Extra-Trees (ET) as base learners, and multilayer perceptron (MLP) neural network as meta-learner. Data was divided into training (464), validation (133), and test (66) sets with a 7:2:1 ratio.

resultsThe proposed multimodal prediction model-mammography ultrasound (MPM-MU) achieved superior performance with an area under the receiver operating characteristic (ROC) Curve (AUC) of 87.9 ± 0.21%, representing improvements of 13.4% and 15.6% over attention-enhanced mammography (74.5%) and ultrasound (72.3%) models, respectively. Ablation studies confirmed the effectiveness of both multimodal feature fusion and attention mechanisms in enhancing diagnostic performance.

conclusionsThe multimodal prediction model-mammography ultrasound (MPM-MU) with modality-specific attention mechanisms demonstrated superior performance in distinguishing between benign and malignant breast tumors compared to single-modality approaches. This approach assists radiologists in improving breast lesion classification accuracy and enhancing clinical decision-making, potentially reducing unnecessary biopsies and improving diagnostic consistency.

Indexed as

Breast NeoplasmsDeep LearningMammographyMultimodal ImagingUltrasonography, MammaryAdultAgedClassification AlgorithmsFemaleHumansMiddle AgedMultilayer PerceptronsPredictive Learning ModelsRandom ForestRetrospective StudiesROC Curveattention mechanismsbreast tumor classificationmammographymultimodalultrasound

Identifiers

PMID41549611
PMCPMC12813411

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.