Scinovex
article Open AccessTop 10% cited

Hebbian learning and spiking neurons

Richard KempterWulfram GerstnerJ. Leo van Hemmen

Abstract

A correlation-based (``Hebbian'') learning rule at a spike level with millisecond resolution is formulated, mathematically analyzed, and compared with learning in a firing-rate description. The relative timing of presynaptic and postsynaptic spikes influences synaptic weights via an asymmetric ``learning window.'' A differential equation for the learning dynamics is derived under the assumption that the time scales of learning and neuronal spike dynamics can be separated. The differential equation is solved for a Poissonian neuron model with stochastic spike arrival. It is shown that correlations between input and output spikes tend to stabilize structure formation. With an appropriate choice of parameters, learning leads to an intrinsic normalization of the average weight and the output firing rate. Noise generates diffusion-like spreading of synaptic weights.

Neural dynamics and brain functionstochastic dynamics and bifurcationAdvanced Memory and Neural ComputingHebbian theorySpike (software development)Learning rulePostsynaptic potentialMillisecondPhysicsStochastic differential equationStatistical physicsComputer scienceNormalization (sociology)

Funding

  • Deutsche Forschungsgemeinschaft
Citations
689
FWCI
9.90
field-weighted impact
References
65
Percentile
99%
vs. same field & year
Citations per year
Cited by
Synaptic Modification by Correlated Activity: Hebb's Postulate Revisited
Annual Review of Neuroscience · 2001 · 1,498 citations
Synaptic plasticity: taming the beast
Nature Neuroscience · 2000 · 2,274 citations
Deep learning in neural networks: An overview
Neural Networks · 2014 · 17,774 citations
References
Noise, neural codes and cortical organization
Current Opinion in Neurobiology · 1994 · 1,292 citations
Advances in neural information processing systems 7
Computers & Mathematics with Applications · 1996 · 14,367 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.