DocumentCode :
901983
Title :
Subgradient-Based Neural Networks for Nonsmooth Nonconvex Optimization Problems
Author :
Bian, Wei ; Xue, Xiaoping
Author_Institution :
Dept. of Math., Harbin Inst. of Technol., Harbin
Volume :
20
Issue :
6
fYear :
2009
fDate :
6/1/2009 12:00:00 AM
Firstpage :
1024
Lastpage :
1038
Abstract :
This paper presents a subgradient-based neural network to solve a nonsmooth nonconvex optimization problem with a nonsmooth nonconvex objective function, a class of affine equality constraints, and a class of nonsmooth convex inequality constraints. The proposed neural network is modeled with a differential inclusion. Under a suitable assumption on the constraint set and a proper assumption on the objective function, it is proved that for a sufficiently large penalty parameter, there exists a unique global solution to the neural network and the trajectory of the network can reach the feasible region in finite time and stay there thereafter. It is proved that the trajectory of the neural network converges to the set which consists of the equilibrium points of the neural network, and coincides with the set which consists of the critical points of the objective function in the feasible region. A condition is given to ensure the convergence to the equilibrium point set in finite time. Moreover, under suitable assumptions, the coincidence between the solution to the differential inclusion and the ldquoslow solutionrdquo of it is also proved. Furthermore, three typical examples are given to present the effectiveness of the theoretic results obtained in this paper and the good performance of the proposed neural network.
Keywords :
gradient methods; neural nets; optimisation; affine equality constraint; nonsmooth convex inequality constraint; nonsmooth nonconvex objective function; nonsmooth nonconvex optimization; subgradient-based neural network; Convergence in finite time; differential inclusion; neural network; nonsmooth nonconvex optimization; slow solution; Algorithms; Computer Simulation; Models, Theoretical; Neural Networks (Computer); Nonlinear Dynamics; Pattern Recognition, Automated;
fLanguage :
English
Journal_Title :
Neural Networks, IEEE Transactions on
Publisher :
ieee
ISSN :
1045-9227
Type :
jour
DOI :
10.1109/TNN.2009.2016340
Filename :
4956970
Link To Document :
بازگشت