Title :
Efficient digital neurons for large scale cortical architectures
Author_Institution :
Univ. of Wisconsin-Madison, Madison, WI, USA
Abstract :
Digital neurons are implemented with the goal of supporting research and development of architectures which implement the computational paradigm of the neocortex. Four spiking digital neurons are implemented at the register transfer level in a manner that permits side-by-side comparisons. Two of the neurons contain two stages of exponential decay, one for synapse conductances and one for membrane potential. The other two neurons contain only one stage of exponential decay for membrane potential. The two stage neurons respond to an input spike with a change in membrane potential that has a non-infinite leading edge slope; the one stage neurons exhibit a change in membrane potential with an abrupt, infinite leading edge slope. This leads to a behavioral difference when a number of input spikes occur in very close time proximity. However, the one stage neurons are as much as a factor of ten more energy efficient than the two stage neurons, as measured by the number of dynamic add-equivalent operations. A new two stage neuron is proposed. This neuron reduces the number of decay components and implements decays in both stages via piece-wise linear approximation. Together, these simplifications yield two stage neuron behavior with energy efficiency that is only about a factor of two worse than the simplest one stage neuron.
Keywords :
approximation theory; neural nets; decay components; dynamic add-equivalent operations; energy efficiency; exponential decay; large scale cortical architectures; leading edge slope; membrane potential; neocortex computational paradigm; piecewise linear approximation; register transfer level; spiking digital neurons; synapse conductances; two stage neuron behavior; Biological system modeling; Biomembranes; Computational modeling; Electric potential; Mathematical model; Neurons;
Conference_Titel :
Computer Architecture (ISCA), 2014 ACM/IEEE 41st International Symposium on
Conference_Location :
Minneapolis, MN
Print_ISBN :
978-1-4799-4396-8
DOI :
10.1109/ISCA.2014.6853206