Evidence mapPaperPMID 38869157Full record

ArticleJournal of medical Internet research2024

Pitfalls in Developing Machine Learning Models for Predicting Cardiovascular Diseases: Challenge and Solutions.

Yu-Qing Cai, Da-Xin Gong, Li-Ying Tang, Yue Cai, Hui-Jun Li, Tian-Ci Jing, Mengchun Gong, Wei Hu, Zhen-Wei Zhang, Xingang Zhang and 1 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 2 pooled it
field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Yu-Qing Cai *The First Hospital of China Medical University, Shenyang, China.ORCID 0009-0006-8552-3629
Da-Xin Gong *Smart Hospital Management Department, The First Hospital of China Medical University, Shenyang, China.ORCID 0009-0007-2015-4364
Li-Ying Tang *The First Hospital of China Medical University, Shenyang, China.ORCID 0009-0003-2493-1627
Yue Cai *The First Hospital of China Medical University, Shenyang, China.ORCID 0000-0003-2886-3791
Hui-Jun LiShenyang Medical & Film Science and Technology Co, Ltd, Shenyang, China.ORCID 0009-0007-8067-4556
Tian-Ci JingSmart Hospital Management Department, The First Hospital of China Medical University, Shenyang, China.ORCID 0009-0002-2436-7627
Mengchun GongDigital Health China Co, Ltd, Beijing, China.ORCID 0000-0001-8197-6643
Wei HuBayi Orthopedic Hospital, Chengdu, China.ORCID 0009-0002-0722-2661
Zhen-Wei ZhangChina Rongtong Medical & Healthcare Co, Ltd, Chengdu, China.ORCID 0009-0005-3761-0640
Xingang ZhangDepartment of Cardiology, The First Hospital of China Medical University, Shenyang, China.ORCID 0000-0001-8811-1634
Guang-Wei ZhangSmart Hospital Management Department, The First Hospital of China Medical University, Shenyang, China.ORCID 0000-0003-0302-4625

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

In recent years, there has been explosive development in artificial intelligence (AI), which has been widely applied in the health care field. As a typical AI technology, machine learning models have emerged with great potential in predicting cardiovascular diseases by leveraging large amounts of medical data for training and optimization, which are expected to play a crucial role in reducing the incidence and mortality rates of cardiovascular diseases. Although the field has become a research hot spot, there are still many pitfalls that researchers need to pay close attention to. These pitfalls may affect the predictive performance, credibility, reliability, and reproducibility of the studied models, ultimately reducing the value of the research and affecting the prospects for clinical application. Therefore, identifying and avoiding these pitfalls is a crucial task before implementing the research. However, there is currently a lack of a comprehensive summary on this topic. This viewpoint aims to analyze the existing problems in terms of data quality, data set characteristics, model design, and statistical methods, as well as clinical implications, and provide possible solutions to these problems, such as gathering objective data, improving training, repeating measurements, increasing sample size, preventing overfitting using statistical methods, using specific AI algorithms to address targeted issues, standardizing outcomes and evaluation criteria, and enhancing fairness and replicability, with the goal of offering reference and assistance to researchers, algorithm developers, policy makers, and clinical practitioners.

Indexed as

Cardiovascular DiseasesMachine LearningAlgorithmsHumansReproducibility of Resultscardiovascular diseasesmachine learningproblemrisk prediction modelssolution

Identifiers

PMID38869157
PMCPMC11316160

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.