Title :
Convergence Analysis of a Class of Nonsmooth Gradient Systems
Author :
Lu, Wenlian ; Wang, Jun
Author_Institution :
Sch. of Math. Sci., Fudan Univ., Shanghai
Abstract :
In this paper, we present new results on convergence of a class of nonlinear dynamical systems modeled by the gradients of nonsmooth cost functions. This class of systems arises from neural-network research and can be regarded as a generalization of existing neural-network models. Using the recently developed Lstrokojasiewicz gradient inequality, the convergence analysis of this gradient-like differential inclusion is given. Without assuming the smoothness of the cost function or analyticity of the activation function, we prove the output convergence of the differential system. In addition, for the piecewise analytic activation function with positive first-order derivative, we prove the state convergence. Furthermore, we also discuss the relationship between the convergence rate and the location of terminal limit point. Numerical examples are provided to illustrate the theoretical results and present the goal-seeking capability of the systems.
Keywords :
convergence; differential equations; nonlinear dynamical systems; Lojasiewicz gradient inequality; convergence analysis; gradient-like differential inclusion; neural-network models; nonlinear dynamical systems; nonsmooth gradient systems; Łojasiewicz inequality; Absolute stability; Lojasiewicz inequality; Nonsmooth cost function; absolute stability; differential inclusion; nonsmooth cost function;
Journal_Title :
Circuits and Systems I: Regular Papers, IEEE Transactions on
DOI :
10.1109/TCSI.2008.925816