Evidence map›Paper›PMID 30381863›Full record

ArticleHuman brain mapping2019

Effective feature learning and fusion of multimodality data using stage-wise deep neural network for dementia diagnosis.

Tao Zhou, Kim-Han Thung, Xiaofeng Zhu, Dinggang Shen

Abstract read
In one paragraph

Article in Human brain mapping, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 81 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
81citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

81 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Flexible Multimodal Neuroimaging Fusion for Alzheimer's Disease Progression Prediction.Applications of medical artificial intelligence. AMAI (Workshop) (4th : 2024 : Taejon-si, Korea) · 2026
    Article
  7. Bridging Gaps in Sundown Syndrome Research: a Scoping Review and Roadmap for Future Multimodal Approaches.Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Review of multimodal machine learning approaches in healthcare.An international journal on information fusion · 2025
    Article
  12. Caregiver perspectives enable accurate diagnosis of neurodegenerative disease.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Article
  13. A Novel Hybrid Ordinal Learning Model with Health Care Application.IEEE transactions on automation science and engineering : a publication of the IEEE Robotics and Automation Society · 2025
    Article
  14. Article
  15. Article
  16. Review
  17. A Cross-Modal Mutual Knowledge Distillation Framework for Alzheimer's Disease Diagnosis: Addressing Incomplete Modalities.IEEE transactions on automation science and engineering : a publication of the IEEE Robotics and Automation Society · 2025
    Article
  18. Article
  19. Article
  20. Article

21 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Tao ZhouDepartment of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina.ORCID 0000-0002-3733-7286
Kim-Han ThungDepartment of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina.
Xiaofeng ZhuDepartment of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina.
Dinggang ShenDepartment of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina.

Funding

Longitudinal Mapping of Human Brain Development in the First Years of LifeR01EB008374 · NIBIB · UNIV OF NORTH CAROLINA CHAPEL HILL · PI YAP, PEW-THIAN · 2009 to 2024
$5.1M
Development of Robust Brain Measurement Tools Informed by Ultrahigh Field 7T MRIR01EB006733 · NIBIB · UNIV OF NORTH CAROLINA CHAPEL HILL · PI YAP, PEW-THIAN · 2008 to 2020
$4.5M
Quantifying Brain Abnormality by Multimodality Neuroimage Analysis,R01AG041721 · NIA · UNIV OF NORTH CAROLINA CHAPEL HILL · PI LIU, MINGXIA · 2012 to 2019
$3.0M
Analyzing Large-Scale Neuroimaging Data in Alzheimer's DiseaseRF1AG053867 · NIA · UNIV OF NORTH CAROLINA CHAPEL HILL · PI YAP, PEW-THIAN · 2016 to 2016
$2.5M
Diagnosis of Alzheimer's Disease Using Dynamic High-Order Brain NetworksR01EB022880 · NIBIB · UNIV OF NORTH CAROLINA CHAPEL HILL · PI YAP, PEW-THIAN · 2016 to 2018
$1.1M
Foundation for the National Institutes of Health AG041721Foundation for the National Institutes of Health AG053867Foundation for the National Institutes of Health EB006733Foundation for the National Institutes of Health EB008374Foundation for the National Institutes of Health EB022880NIA NIH HHS R01 AG041721NIA NIH HHS RF1 AG053867NIBIB NIH HHS R01 EB006733NIBIB NIH HHS R01 EB008374NIBIB NIH HHS R01 EB022880
6 · The paper itself

Abstract

In this article, the authors aim to maximally utilize multimodality neuroimaging and genetic data for identifying Alzheimer's disease (AD) and its prodromal status, Mild Cognitive Impairment (MCI), from normal aging subjects. Multimodality neuroimaging data such as MRI and PET provide valuable insights into brain abnormalities, while genetic data such as single nucleotide polymorphism (SNP) provide information about a patient's AD risk factors. When these data are used together, the accuracy of AD diagnosis may be improved. However, these data are heterogeneous (e.g., with different data distributions), and have different number of samples (e.g., with far less number of PET samples than the number of MRI or SNPs). Thus, learning an effective model using these data is challenging. To this end, we present a novel three-stage deep feature learning and fusion framework, where deep neural network is trained stage-wise. Each stage of the network learns feature representations for different combinations of modalities, via effective training using the maximum number of available samples. Specifically, in the first stage, we learn latent representations (i.e., high-level features) for each modality independently, so that the heterogeneity among modalities can be partially addressed, and high-level features from different modalities can be combined in the next stage. In the second stage, we learn joint latent features for each pair of modality combination by using the high-level features learned from the first stage. In the third stage, we learn the diagnostic labels by fusing the learned joint latent features from the second stage. To further increase the number of samples during training, we also use data at multiple scanning time points for each training subject in the dataset. We evaluate the proposed framework using Alzheimer's disease neuroimaging initiative (ADNI) dataset for AD diagnosis, and the experimental results show that the proposed framework outperforms other state-of-the-art methods.

Indexed as

Deep LearningAgedCognitive DysfunctionDementiaFemaleHumansMaleMiddle AgedMultimodal ImagingNeuroimagingPolymorphism, Single NucleotideAlzheimer's disease (AD)deep learningmild cognitive impairment (MCI)multimodality data fusion

Identifiers

PMID30381863
PMCPMC6865441

What Socratic holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.