University of Sussex
Browse
fnana-10-00037.pdf (3.45 MB)

Large-Scale simulations of plastic neural networks on neuromorphic hardware

Download (3.45 MB)
journal contribution
posted on 2023-06-09, 07:05 authored by James KnightJames Knight, Philip J Tully, Bernhard A Kaplan, Anders Lansner, Steve B Furber
SpiNNaker is a digital, neuromorphic architecture designed for simulating large-scale spiking neural networks at speeds close to biological real-time. Rather than using bespoke analog or digital hardware, the basic computational unit of a SpiNNaker system is a general-purpose ARM processor, allowing it to be programmed to simulate a wide variety of neuron and synapse models. This flexibility is particularly valuable in the study of biological plasticity phenomena. A recently proposed learning rule based on the Bayesian Confidence Propagation Neural Network (BCPNN) paradigm offers a generic framework for modeling the interaction of different plasticity mechanisms using spiking neurons. However, it can be computationally expensive to simulate large networks with BCPNN learning since it requires multiple state variables for each synapse, each of which needs to be updated every simulation time-step. We discuss the trade-offs in efficiency and accuracy involved in developing an event-based BCPNN implementation for SpiNNaker based on an analytical solution to the BCPNN equations, and detail the steps taken to fit this within the limited computational and memory resources of the SpiNNaker architecture. We demonstrate this learning rule by learning temporal sequences of neural activity within a recurrent attractor network which we simulate at scales of up to 2.0 × 104 neurons and 5.1 × 107 plastic synapses: the largest plastic neural network ever to be simulated on neuromorphic hardware. We also run a comparable simulation on a Cray XC-30 supercomputer system and find that, if it is to match the run-time of our SpiNNaker simulation, the super computer system uses approximately 45× more power. This suggests that cheaper, more power efficient neuromorphic systems are becoming useful discovery tools in the study of plasticity in large-scale brain models.

History

Publication status

  • Published

File Version

  • Published version

Journal

Frontiers in Neuroanatomy

ISSN

1662-5129

Publisher

Frontiers Media

Volume

10

Article number

a37

Department affiliated with

  • Informatics Publications

Research groups affiliated with

  • Centre for Computational Neuroscience and Robotics Publications
  • Sussex Neuroscience Publications

Full text available

  • Yes

Peer reviewed?

  • Yes

Legacy Posted Date

2017-07-18

First Open Access (FOA) Date

2017-07-18

First Compliant Deposit (FCD) Date

2017-07-18

Usage metrics

    University of Sussex (Publications)

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC