DocumentCode
901983
Title
Subgradient-Based Neural Networks for Nonsmooth Nonconvex Optimization Problems
Author
Bian, Wei ; Xue, Xiaoping
Author_Institution
Dept. of Math., Harbin Inst. of Technol., Harbin
Volume
20
Issue
6
fYear
2009
fDate
6/1/2009 12:00:00 AM
Firstpage
1024
Lastpage
1038
Abstract
This paper presents a subgradient-based neural network to solve a nonsmooth nonconvex optimization problem with a nonsmooth nonconvex objective function, a class of affine equality constraints, and a class of nonsmooth convex inequality constraints. The proposed neural network is modeled with a differential inclusion. Under a suitable assumption on the constraint set and a proper assumption on the objective function, it is proved that for a sufficiently large penalty parameter, there exists a unique global solution to the neural network and the trajectory of the network can reach the feasible region in finite time and stay there thereafter. It is proved that the trajectory of the neural network converges to the set which consists of the equilibrium points of the neural network, and coincides with the set which consists of the critical points of the objective function in the feasible region. A condition is given to ensure the convergence to the equilibrium point set in finite time. Moreover, under suitable assumptions, the coincidence between the solution to the differential inclusion and the ldquoslow solutionrdquo of it is also proved. Furthermore, three typical examples are given to present the effectiveness of the theoretic results obtained in this paper and the good performance of the proposed neural network.
Keywords
gradient methods; neural nets; optimisation; affine equality constraint; nonsmooth convex inequality constraint; nonsmooth nonconvex objective function; nonsmooth nonconvex optimization; subgradient-based neural network; Convergence in finite time; differential inclusion; neural network; nonsmooth nonconvex optimization; slow solution; Algorithms; Computer Simulation; Models, Theoretical; Neural Networks (Computer); Nonlinear Dynamics; Pattern Recognition, Automated;
fLanguage
English
Journal_Title
Neural Networks, IEEE Transactions on
Publisher
ieee
ISSN
1045-9227
Type
jour
DOI
10.1109/TNN.2009.2016340
Filename
4956970
Link To Document