Evidence map›Paper›PMID 36249482›Full record

ArticleFrontiers in computational neuroscience2022

Training spiking neuronal networks to perform motor control using reinforcement and evolutionary learning.

Daniel Haşegan, Matt Deible, Christopher Earl, David D'Onofrio, Hananel Hazan, Haroon Anwar, Samuel A Neymotin

Abstract read
In one paragraph

Article in Frontiers in computational neuroscience, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Spark: modular spiking neural networks.Frontiers in artificial intelligence · 2026
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Large-Scale Mechanistic Models of Brain Circuits with Biophysically and Morphologically Detailed Neurons.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2024
    Review
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Daniel HaşeganVilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, New York, NY, United States.
Matt DeibleDepartment of Computer Science, University of Pittsburgh, Pittsburgh, PA, United States.
Christopher EarlDepartment of Computer Science, University of Massachusetts Amherst, Amherst, MA, United States.
David D'OnofrioCenter for Biomedical Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States.
Hananel HazanAllen Discovery Center, Tufts University, Boston, MA, United States.
Haroon AnwarCenter for Biomedical Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States.
Samuel A NeymotinCenter for Biomedical Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States.

Funding

Cortical and thalamic mechanisms of selective auditory attentionR01DC012947 · NIDCD · NATHAN S. KLINE INSTITUTE FOR PSYCH RES · PI NEYMOTIN, SAMUEL A, SCHROEDER, CHARLES E · 2013 to 2022
$5.2M
NIDCD NIH HHS R01 DC012947
6 · The paper itself

Abstract

Artificial neural networks (ANNs) have been successfully trained to perform a wide range of sensory-motor behaviors. In contrast, the performance of spiking neuronal network (SNN) models trained to perform similar behaviors remains relatively suboptimal. In this work, we aimed to push the field of SNNs forward by exploring the potential of different learning mechanisms to achieve optimal performance. We trained SNNs to solve the CartPole reinforcement learning (RL) control problem using two learning mechanisms operating at different timescales: (1) spike-timing-dependent reinforcement learning (STDP-RL) and (2) evolutionary strategy (EVOL). Though the role of STDP-RL in biological systems is well established, several other mechanisms, though not fully understood, work in concert during learning

Indexed as

computer simulationevolutionary strategyreinforcement learningsensory-motor behaviorspike-timing dependent plasticity (STDP)spiking neuronal networksvideo games

Identifiers

PMID36249482
PMCPMC9563231

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.