An effective machine learning algorithm using momentum scheduling

This paper proposes a new algorithm to improve learning performance in support vector machine by using the kernel relaxation and the dynamic momentum. Compared with the static momentum, the dynamic momentum is simultaneously obtained by the learning process of pattern weight and reflected into different momentum by the current state. Therefore, the proposed dynamic momentum algorithm can effectively control the convergence rate and performance. The experiment using SONAR data shows that the proposed algorithm has better convergence rate and performance than the kernel relaxation using static momentum.