Evidence map›Paper›PMID 37632414›Full record

ArticleJournal of medical Internet research2023

Large-Scale Biomedical Relation Extraction Across Diverse Relation Types: Model Development and Usability Study on COVID-19.

Zeyu Zhang, Meng Fang, Rebecca Wu, Hui Zong, Honglian Huang, Yuantao Tong, Yujia Xie, Shiyang Cheng, Ziyi Wei, M James C Crabbe and 2 more

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
0.6field-weighted citation impact, top 30% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 4 citations in OpenAlex.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 6 institutions in 3 countries.

Zeyu ZhangResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0002-5179-1194
Meng FangDepartment of Laboratory Medicine, Shanghai Eastern Hepatobiliary Surgery Hospital, Shanghai, China.ORCID 0000-0001-6235-6545
Rebecca WuUniversity of California, Berkeley, Berkeley, CA, United States.ORCID 0009-0007-8124-6529
Hui ZongResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0002-9142-5017
Honglian HuangResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0009-0003-2739-5348
Yuantao TongResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0003-4929-7450
Yujia XieResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0003-1740-0134
Shiyang ChengResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0003-2344-5574
Ziyi WeiResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0009-0009-0603-9401
M James C CrabbeWolfson College, Oxford University, Oxford, United Kingdom.ORCID 0000-0003-3609-1963
Xiaoyan ZhangResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0003-1562-0045
Ying WangResearch Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.ORCID 0000-0002-1819-294X
Shanghai East Hospital · CNSecond Military Medical University · CNShanghai University of Traditional Chinese Medicine · CNSichuan University · CNUniversity of Bedfordshire · GBUniversity of California, Berkeley · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundBiomedical relation extraction (RE) is of great importance for researchers to conduct systematic biomedical studies. It not only helps knowledge mining, such as knowledge graphs and novel knowledge discovery, but also promotes translational applications, such as clinical diagnosis, decision-making, and precision medicine. However, the relations between biomedical entities are complex and diverse, and comprehensive biomedical RE is not yet well established.

objectiveWe aimed to investigate and improve large-scale RE with diverse relation types and conduct usability studies with application scenarios to optimize biomedical text mining.

methodsData sets containing 125 relation types with different entity semantic levels were constructed to evaluate the impact of entity semantic information on RE, and performance analysis was conducted on different model architectures and domain models. This study also proposed a continued pretraining strategy and integrated models with scripts into a tool. Furthermore, this study applied RE to the COVID-19 corpus with article topics and application scenarios of clinical interest to assess and demonstrate its biological interpretability and usability.

resultsThe performance analysis revealed that RE achieves the best performance when the detailed semantic type is provided. For a single model, PubMedBERT with continued pretraining performed the best, with an F1-score of 0.8998. Usability studies on COVID-19 demonstrated the interpretability and usability of RE, and a relation graph database was constructed, which was used to reveal existing and novel drug paths with edge explanations. The models (including pretrained and fine-tuned models), integrated tool (Docker), and generated data (including the COVID-19 relation graph database and drug paths) have been made publicly available to the biomedical text mining community and clinical researchers.

conclusionsThis study provided a comprehensive analysis of RE with diverse relation types. Optimized RE models and tools for diverse relation types were developed, which can be widely used in biomedical text mining. Our usability studies provided a proof-of-concept demonstration of how large-scale RE can be leveraged to facilitate novel research.

Indexed as

COVID-19Databases, FactualData MiningHumansKnowledgePrecision Medicinebiomedical relation extractionbiomedical text miningclinical drug pathCOVID-19knowledge discoveryknowledge graphpretrained language modeltask-adaptive pretraining

Identifiers

PMID37632414
PMCPMC10551783
OpenAlexW4386163596

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.