Title :
Link between energy and computation in a physical model of Hopfield network
Author :
Kumar, Abhishek ; Manmohan, V. ; Shankar, M. Uday ; Vishwanathan, M. ; Chakravarthy, V.S.
Author_Institution :
Dept. of Electr. Eng., Indian Inst. of Technol. Madras, Chennai, India
Abstract :
Linking information processing and energy flows via thermodynamics, Landauer (1961) proposed that irreversible computational processes have an inevitable "thermodynamic cost". We explore the existence of such a link in case of a neural network model of associative memory. Our simulations with an electronic implementation of the Hopfield neural network showed that enhanced performance of the network could only be obtained by increased dissipation of energy as heat. Contrarily, efforts to minimize energy dissipation led to impaired performance.
Keywords :
Hopfield neural nets; content-addressable storage; cooling; neural chips; performance evaluation; associative memory; electronic implementation; energy dissipation; energy flows; information processing; irreversible computational processes; neural network model; physical Hopfield network model; thermodynamic cost; thermodynamics; Associative memory; Computational modeling; Computer networks; Costs; Hopfield neural networks; Information processing; Joining processes; Neural networks; Physics computing; Thermodynamics;
Conference_Titel :
Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
Print_ISBN :
981-04-7524-1
DOI :
10.1109/ICONIP.2002.1202175
