Evidence map›Paper›PMID 34579793›Full record

ArticleGenome biology2021

Biologically relevant transfer learning improves transcription factor binding prediction.

Gherman Novakovsky, Manu Saraswat, Oriol Fornes, Sara Mostafavi, Wyeth W Wasserman

Abstract readEvaluation Study
In one paragraph

Article in Genome biology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Modeling strategies forBioinformatics advances · 2026
    Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Gherman Novakovsky *Centre for Molecular Medicine and Therapeutics, BC Children's Hospital Research Institute, Vancouver, BC, V5Z 4H4, Canada.ORCID 0000-0002-7089-5941
Manu Saraswat *Centre for Molecular Medicine and Therapeutics, BC Children's Hospital Research Institute, Vancouver, BC, V5Z 4H4, Canada.ORCID 0000-0002-1472-8049
Oriol Fornes *Centre for Molecular Medicine and Therapeutics, BC Children's Hospital Research Institute, Vancouver, BC, V5Z 4H4, Canada. oriol@cmmt.ubc.ca.ORCID 0000-0002-5969-3054
Sara MostafaviCentre for Molecular Medicine and Therapeutics, BC Children's Hospital Research Institute, Vancouver, BC, V5Z 4H4, Canada.ORCID 0000-0003-4698-1177
Wyeth W WassermanCentre for Molecular Medicine and Therapeutics, BC Children's Hospital Research Institute, Vancouver, BC, V5Z 4H4, Canada. wyeth@cmmt.ubc.ca.ORCID 0000-0001-6098-6412

Funding

CIHR PJT-162120
6 · The paper itself

Abstract

backgroundDeep learning has proven to be a powerful technique for transcription factor (TF) binding prediction but requires large training datasets. Transfer learning can reduce the amount of data required for deep learning, while improving overall model performance, compared to training a separate model for each new task.

resultsWe assess a transfer learning strategy for TF binding prediction consisting of a pre-training step, wherein we train a multi-task model with multiple TFs, and a fine-tuning step, wherein we initialize single-task models for individual TFs with the weights learned by the multi-task model, after which the single-task models are trained at a lower learning rate. We corroborate that transfer learning improves model performance, especially if in the pre-training step the multi-task model is trained with biologically relevant TFs. We show the effectiveness of transfer learning for TFs with ~ 500 ChIP-seq peak regions. Using model interpretation techniques, we demonstrate that the features learned in the pre-training step are refined in the fine-tuning step to resemble the binding motif of the target TF (i.e., the recipient of transfer learning in the fine-tuning step). Moreover, pre-training with biologically relevant TFs allows single-task models in the fine-tuning step to learn useful features other than the motif of the target TF.

conclusionsOur results confirm that transfer learning is a powerful technique for TF binding prediction.

Indexed as

Machine LearningChromatin Immunoprecipitation SequencingGenomeTranscription FactorsTranscription FactorsDeep learningModel interpretationTranscription factor binding predictionTransfer learning

Identifiers

PMID34579793
PMCPMC8474956

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.