Title :
`Entropy production rate´ and `entropy´ for neural networks
Author :
Chang, Hung-Jen ; Huang, Kung-Shiuh ; Huang, Kuan-Tsao
Author_Institution :
Dept. of Phys., Texas Univ., Austin, TX, USA
Abstract :
Two new quantities for neural networks, entropy production rate and entropy, are derived. In the Hopfield neural model, Hopfield introduced a quantity, energy, and the energy minimum corresponds to a possible good solution to a problem. It is shown that the energy function does not match the physical meaning of energy in physics; a better physical interpretation can go through entropy production rate and entropy in physics. These new quantities can be further extended to general nonequilibrium open systems for neural networks
Keywords :
neural nets; Hopfield neural model; entropy; entropy production rate; neural networks; nonequilibrium open systems; Biological neural networks; Circuits; Costs; Entropy; Equations; Neural networks; Neurons; Physics; Production; Thermodynamics;
Conference_Titel :
Computer Software and Applications Conference, 1989. COMPSAC 89., Proceedings of the 13th Annual International
Conference_Location :
Orlando, FL
Print_ISBN :
0-8186-1964-3
DOI :
10.1109/CMPSAC.1989.65162