On the equivalence of Hebbian learning and the SVM formalism

Nowotny, Thomas and Huerta, Ramón (2012) On the equivalence of Hebbian learning and the SVM formalism. In: Information Sciences and Systems (CISS), 2012 46th Annual Conference on, 21-23 March 2012, Princeton, NJ.

Full text not available from this repository.


We show that it is possible to relate the Support Vector Machine formalism to Hebbian Learning in the context of olfactory learning in the insect brain. Since neurons cannot have negative firing rates, two neurons and synaptic inhibition are required to encode a binary classification problem in a biologically realistic way. We show that the two neuron system with plausible Hebbian learning rules can be mapped to a large margin classifier. Two formalisms are analyzed: regular SVMs and the so-called inhibitory SVMs. The regularization term in regular SVMs brings the synaptic vectors of the two neurons close to each other, while the inhibitory SVM can bring them to 0 resembling the memory loss process in Hebbian learning. Based on the analogy to large margin classifiers we also predict the existence of a negative Hebbian leaning rule for negative reinforcement signals.

Item Type: Conference or Workshop Item (Paper)
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science
Q Science > Q Science (General)
Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Depositing User: Thomas Nowotny
Date Deposited: 30 Jun 2016 07:08
Last Modified: 30 Jun 2016 07:08
URI: http://sro.sussex.ac.uk/id/eprint/61789
📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
Olfactory Coding in the Insect Pheromone Pathway: Models and ExperimentsG0299BBSRC-BIOTECHNOLOGY & BIOLOGICAL SCIENCES RESEARCH COUNCILBB/F00513/1