Title :
The effect of the temperature parameter on convergence in the Boltzmann machines
Author :
Shtram, Lior ; Policker, Shai ; Geva, Amir B.
Author_Institution :
Dept. of Electr. & Comput. Eng., Ben-Gurion Univ. of the Negev, Beer-Sheva, Israel
Abstract :
Boltzmann machines show attractive features in traditional neural network tasks. We tested the robustness of the Boltzmann machine in a non-linear mapping task. The system´s errors were classified into several categories and the distribution of errors between the categories was studied. Using simulations, it is demonstrated that limitation of the temperature parameter causes the distribution of the network´s errors to be unique and different from its usual error distribution. The phenomenon receives a mathematical explanation rooted in the statistical mechanics basics of the Boltzmann machine. This has applications in designing and evaluating mapping tasks for the Boltzmann machines and can help speed up system convergence, which is known to be a major deficit of the Boltzmann machine
Keywords :
Boltzmann machines; convergence; error analysis; statistical mechanics; Boltzmann machines; convergence; error distribution; neural network task; nonlinear mapping task; robustness; statistical mechanics; temperature parameter; Communication channels; Computer errors; Convergence; Decoding; Intelligent networks; Neural networks; Robustness; Table lookup; Temperature distribution; Testing;
Conference_Titel :
Electrical and Electronics Engineers in Israel, 1996., Nineteenth Convention of
Conference_Location :
Jerusalem
Print_ISBN :
0-7803-3330-6
DOI :
10.1109/EEIS.1996.566929
