Evidence map›Paper›PMID 39415214›Full record

ArticleJournal of biomedical semantics2024

Dynamic Retrieval Augmented Generation of Ontologies using Artificial Intelligence (DRAGON-AI).

Sabrina Toro, Anna V Anagnostopoulos, Susan M Bello, Kai Blumberg, Rhiannon Cameron, Leigh Carmody, Alexander D Diehl, Damion M Dooley, William D Duncan, Petra Fey and 20 more

Abstract read
In one paragraph

Article in Journal of biomedical semantics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed.

  1. AI semantics for biomedical data integration.bioRxiv : the preprint server for biology · 2026
    Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. The Gene Ontology knowledgebase in 2026.Nucleic acids research · 2026
    Article
  9. Evaluating RAG and Non-RAG Pipelines for Concept Discovery in Environmental Health Ontologies.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026
    Article
  10. Article
  11. Article
  12. Review
  13. Large Language Models in Bio-Ontology Research: A Review.Bioengineering (Basel, Switzerland) · 2025
    Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. A change language for ontologies and knowledge graphs.Database : the journal of biological databases and curation · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

30 authors.

Sabrina ToroUniversity of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Anna V AnagnostopoulosThe Jackson Laboratory, Bar Harbor, ME, USA.
Susan M BelloThe Jackson Laboratory, Bar Harbor, ME, USA.
Kai BlumbergDepartment of Agriculture, Beltsville Human Nutrition Research Center, Beltsville, MD, USA.
Rhiannon CameronSimon Fraser University, Burnaby, BC, Canada.
Leigh CarmodyThe Jackson Laboratory for Genomic Medicine, Farmington, CT, USA.
Alexander D DiehlUniversity at Buffalo, Buffalo, NY, USA.
Damion M DooleySimon Fraser University, Burnaby, BC, Canada.
William D DuncanUniversity of Florida, Gainesville, FL, USA.
Petra FeyNorthwestern University, Evanston, IL, USA.
Pascale GaudetSIB Swiss Institute of Bioinformatics, Geneva, Switzerland.
Nomi L HarrisLawrence Berkeley National Laboratory, Berkeley, CA, USA.
Marcin P JoachimiakLawrence Berkeley National Laboratory, Berkeley, CA, USA.
Leila KianiIndependent Scientific Information Analyst, Philadelphia, USA.
Tiago LubianaUniversity of São Paulo, São Paulo, Brazil.
Monica C Munoz-TorresUniversity of Colorado Anschutz Medical Campus, Aurora, CO, USA.
Shawn O'NeilUniversity of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
David Osumi-SutherlandSanger Institute, Hinxton, UK.
Aleix Puig-BarbeEuropean Bioinformatics Institute (EMBL-EBI), Hinxton, UK.
Justin T ReeseLawrence Berkeley National Laboratory, Berkeley, CA, USA.
Leonore ReiserPhoenix Bioinformatics, Newark, CA, USA.
Sofia Mc RobbStowers Institute for Medical Research, Kansas City, MO, USA.
Troy RuempingIC-FOODS, Austin, TX, USA.
James SeagerRothamsted Research, Harpenden, UK.
Eric SidNational Center for Advancing Translational Sciences, Bethesda, MD, USA.
Ray StefancsikEuropean Bioinformatics Institute (EMBL-EBI), Hinxton, UK.
Magalie WeberINRAE, French National Research Institute for Agriculture, Food and Environment, UR BIA, Nantes, France.
Valerie WoodUniversity of Cambridge, Cambridge, UK.
Melissa A HaendelUniversity of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Christopher J MungallLawrence Berkeley National Laboratory, Berkeley, CA, USA. cjmungall@lbl.gov.

Funding

UNC-CH CENTER FOR ENVIRONMENTAL HEALTH &SUSCEPTIBILITYP30ES010126 · NIEHS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI Hazel B Nichols · 2001 to 2026
$36.3M
University of Buffalo Clinical and Translational Science Institute - Supplement SchulyerUL1TR001412 · NCATS · STATE UNIVERSITY OF NEW YORK AT BUFFALO · PI MURPHY, TIMOTHY F · 2015 to 2024
$33.8M
Gene Ontology Consortium and KnowledgebaseU24HG012212 · NHGRI · UNIVERSITY OF SOUTHERN CALIFORNIA · PI CHRISTOPHER J MUNGALL, PAUL Warren STERNBERG · 2022 to 2026
$11.6M
Improvements to the LinkML framework to support the Phenomics First open science resourceRM1HG010860 · NHGRI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI HAENDEL, MELISSA A, MUNGALL, CHRISTOPHER J · 2020 to 2024
$10.3M
NCATS NIH HHS UL1 TR001412NHGRI NIH HHS RM1 HG010860NHGRI NIH HHS U24 HG012212NIEHS NIH HHS P30 ES010126
6 · The paper itself

Abstract

backgroundOntologies are fundamental components of informatics infrastructure in domains such as biomedical, environmental, and food sciences, representing consensus knowledge in an accurate and computable form. However, their construction and maintenance demand substantial resources and necessitate substantial collaboration between domain experts, curators, and ontology experts. We present Dynamic Retrieval Augmented Generation of Ontologies using AI (DRAGON-AI), an ontology generation method employing Large Language Models (LLMs) and Retrieval Augmented Generation (RAG). DRAGON-AI can generate textual and logical ontology components, drawing from existing knowledge in multiple ontologies and unstructured text sources.

resultsWe assessed performance of DRAGON-AI on de novo term construction across ten diverse ontologies, making use of extensive manual evaluation of results. Our method has high precision for relationship generation, but has slightly lower precision than from logic-based reasoning. Our method is also able to generate definitions deemed acceptable by expert evaluators, but these scored worse than human-authored definitions. Notably, evaluators with the highest level of confidence in a domain were better able to discern flaws in AI-generated definitions. We also demonstrated the ability of DRAGON-AI to incorporate natural language instructions in the form of GitHub issues.

conclusionsThese findings suggest DRAGON-AI's potential to substantially aid the manual ontology construction process. However, our results also underscore the importance of having expert curators and ontology editors drive the ontology generation process.

Indexed as

Artificial IntelligenceBiological OntologiesNatural Language ProcessingInformation Storage and RetrievalArtificial intelligenceBiocurationKnowledge graphsLarge language modelsOntologiesOntology engineering

Identifiers

PMID39415214
PMCPMC11484368

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.