Evidence map›Paper›PMID 38383067›Full record

ArticleBioinformatics (Oxford, England)2024

Structured Prompt Interrogation and Recursive Extraction of Semantics (SPIRES): a method for populating knowledge bases using zero-shot learning.

J Harry Caufield, Harshad Hegde, Vincent Emonet, Nomi L Harris, Marcin P Joachimiak, Nicolas Matentzoglu, HyeongSik Kim, Sierra Moxon, Justin T Reese, Melissa A Haendel and 2 more

Abstract read
In one paragraph

Article in Bioinformatics (Oxford, England), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers.

0numbers the graph read from it
0cells of the map it votes in
45citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

45 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Rosetta Statements: simplifying FAIR knowledge graph construction with a user-centred approach.Database : the journal of biological databases and curation · 2026
    Article
  12. The Gene Ontology knowledgebase in 2026.Nucleic acids research · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Large Language Models in Bio-Ontology Research: A Review.Bioengineering (Basel, Switzerland) · 2025
    Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

J Harry CaufieldBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0001-5705-7831
Harshad HegdeBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0002-2411-565X
Vincent EmonetInstitute of Data Science, Faculty of Science and Engineering, Maastricht University, 6200 MD Maastricht, The Netherlands.ORCID 0000-0002-1501-1082
Nomi L HarrisBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0001-6315-3707
Marcin P JoachimiakBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0001-8175-045X
Nicolas MatentzogluSemanticly, Athens, Greece.ORCID 0000-0002-7356-1779
HyeongSik KimRobert Bosch LLC, Sunnyvale, CA 94085, United States.ORCID 0000-0002-3002-9838
Sierra MoxonBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0002-8719-7760
Justin T ReeseBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0002-2170-2250
Melissa A HaendelDepartment of Biomedical Informatics, University of Colorado, Anschutz Medical Campus, Aurora, CO 80217, United States.ORCID 0000-0001-9114-8737
Peter N RobinsonBerlin Institute of Health at Charité, 10178 Berlin, Germany.ORCID 0000-0002-0736-9199
Christopher J MungallBiosystems Data Science, Division of Environmental Genomics and Systems Biology, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, United States.ORCID 0000-0002-6601-2165

Funding

The Monarch Initiative: Linking Diseases to Model Organism ResourcesR24OD011883 · OD · UNIV OF NORTH CAROLINA CHAPEL HILL · PI HAENDEL, MELISSA A, MUNGALL, CHRISTOPHER J · 2012 to 2024
$16.0M
Improvements to the LinkML framework to support the Phenomics First open science resourceRM1HG010860 · NHGRI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI HAENDEL, MELISSA A, MUNGALL, CHRISTOPHER J · 2020 to 2024
$10.3M
The Human Phenotype Ontology: Accelerating Computational Integration of Clinical Data for GenomicsU24HG011449 · NHGRI · JACKSON LABORATORY · PI Peter Nicholas Robinson · 2021 to 2026
$6.7M
NHGRI NIH HHS RM1 HG010860NHGRI NIH HHS U24 HG011449NIH HHS R24 OD011883ODCDC CDC HHS R24 OD011883
6 · The paper itself

Abstract

motivationCreating knowledge bases and ontologies is a time consuming task that relies on manual curation. AI/NLP approaches can assist expert curators in populating these knowledge bases, but current approaches rely on extensive training data, and are not able to populate arbitrarily complex nested knowledge schemas.

resultsHere we present Structured Prompt Interrogation and Recursive Extraction of Semantics (SPIRES), a Knowledge Extraction approach that relies on the ability of Large Language Models (LLMs) to perform zero-shot learning and general-purpose query answering from flexible prompts and return information conforming to a specified schema. Given a detailed, user-defined knowledge schema and an input text, SPIRES recursively performs prompt interrogation against an LLM to obtain a set of responses matching the provided schema. SPIRES uses existing ontologies and vocabularies to provide identifiers for matched elements. We present examples of applying SPIRES in different domains, including extraction of food recipes, multi-species cellular signaling pathways, disease treatments, multi-step drug mechanisms, and chemical to disease relationships. Current SPIRES accuracy is comparable to the mid-range of existing Relation Extraction methods, but greatly surpasses an LLM's native capability of grounding entities with unique identifiers. SPIRES has the advantage of easy customization, flexibility, and, crucially, the ability to perform new tasks in the absence of any new training data. This method supports a general strategy of leveraging the language interpreting capabilities of LLMs to assemble knowledge bases, assisting manual knowledge curation and acquisition while supporting validation with publicly-available databases and ontologies external to the LLM. AVAILABILITY AND IMPLEMENTATION: SPIRES is available as part of the open source OntoGPT package: https://github.com/monarch-initiative/ontogpt.

Indexed as

Knowledge BasesSemanticsDatabases, Factual

Identifiers

PMID38383067
PMCPMC10924283

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.