Evidence map›Paper›PMID 40456759›Full record

ArticleScientific reports2025

Out-of-distribution reject option method for dataset shift problem in early disease onset prediction.

Taisei Tosaki, Eiichiro Uchino, Ryosuke Kojima, Yohei Mineharu, Yuji Okamoto, Mikio Arita, Nobuyuki Miyai, Yoshinori Tamada, Tatsuya Mikami, Koichi Murashita and 2 more

Abstract read
In one paragraph

Article in Scientific reports, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Taisei TosakiGraduate School of Medicine, Kyoto University, Kyoto, Japan.
Eiichiro UchinoGraduate School of Medicine, Kyoto University, Kyoto, Japan.
Ryosuke KojimaGraduate School of Medicine, Kyoto University, Kyoto, Japan.
Yohei MineharuGraduate School of Medicine, Kyoto University, Kyoto, Japan.
Yuji OkamotoGraduate School of Medicine, Kyoto University, Kyoto, Japan.
Mikio AritaGraduate School of Health and Nursing Science, Wakayama Medical University, Wakayama, Japan.
Nobuyuki MiyaiGraduate School of Health and Nursing Science, Wakayama Medical University, Wakayama, Japan.
Yoshinori TamadaResearch Center for Health-Medical Data Science, Graduate School of Medicine, Hirosaki University, Hirosaki, Japan.
Tatsuya MikamiInnovation Center for Health Promotion, Graduate School of Medicine, Hirosaki University, Hirosaki, Japan.
Koichi MurashitaCenter of Innovation Research Initiatives Organization, Hirosaki University, Hirosaki, Japan.
Shigeyuki NakajiInnovation Center for Health Promotion, Graduate School of Medicine, Hirosaki University, Hirosaki, Japan.
Yasushi OkunoGraduate School of Medicine, Kyoto University, Kyoto, Japan. okuno.yasushi.4c@kyoto-u.ac.jp.

Funding

Center of Innovation Program JPMJCE1302Program on Open Innovation Platforms for Indsutry-academia Co-creation JPMJCA2201
6 · The paper itself

Abstract

Machine learning is increasingly used to predict lifestyle-related disease onset using health and medical data. However, its predictive accuracy for use is often hindered by dataset shift, which refers to discrepancies in data distribution between the training and testing datasets. This issue leads to the misclassification of out-of-distribution (OOD) data. To diminish dataset shift in real-world settings, this paper proposes the out-of-distribution reject option for prediction (ODROP). This method integrates an OOD detection model to preclude OOD data from the prediction phase. We used two real-world health checkup datasets (Hirosaki and Wakayama) with dataset shift, across three disease onset prediction tasks: diabetes, dyslipidemia, and hypertension. Both components of ODROP method-the OOD detection model and the prediction model-were trained on the Hirosaki dataset. We assessed the effectiveness of ODROP on the Wakayama dataset using AUROC-rejection rate curve plot. In the five OOD detection approaches (the variational autoencoder, neural network ensemble std, neural network ensemble epistemic, neural network energy, and neural network Gaussian mixture based energy measurement), the variational autoencoder method demonstrated notably higher stability and a greater improvement in AUROC. For example, in the Wakayama dataset, the AUROC for diabetes onset increased from 0.80 without ODROP to 0.90 at a 31.1% rejection rate, and for dyslipidemia, it improved from 0.70 without ODROP to 0.76 at a 34% rejection rate. In addition, we were able to categorize dataset shifts into two types using SHAP clustering-those that considerably affect predictions and those that do not. We expect that this classification will help standardize measuring instruments. This study is the first to apply OOD detection to actual health and medical data, demonstrating its potential to substantially improve the accuracy and reliability of disease prediction models amidst dataset shift.

Indexed as

Diabetes MellitusDyslipidemiasHypertensionMachine LearningDatasets as TopicFemaleHumansMaleNeural Networks, Computer

Identifiers

PMID40456759
PMCPMC12130293

What Socratic holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.