Title :
Generalized neural network for nonsmooth nonlinear programming problems
Author :
Forti, Mauro ; Nistri, Paolo ; Quincampoix, Marc
Author_Institution :
Dipt. di Ingegneria dell´´Informazione, Univ. di Siena, Italy
Abstract :
In 1988 Kennedy and Chua introduced the dynamical canonical nonlinear programming circuit (NPC) to solve in real time nonlinear programming problems where the objective function and the constraints are smooth (twice continuously differentiable) functions. In this paper, a generalized circuit is introduced (G-NPC), which is aimed at solving in real time a much wider class of nonsmooth nonlinear programming problems where the objective function and the constraints are assumed to satisfy only the weak condition of being regular functions. G-NPC, which derives from a natural extension of NPC, has a neural-like architecture and also features the presence of constraint neurons modeled by ideal diodes with infinite slope in the conducting region. By using the Clarke´s generalized gradient of the involved functions, G-NPC is shown to obey a gradient system of differential inclusions, and its dynamical behavior and optimization capabilities, both for convex and nonconvex problems, are rigorously analyzed in the framework of nonsmooth analysis and the theory of differential inclusions. In the special important case of linear and quadratic programming problems, salient dynamical features of G-NPC, namely the presence of sliding modes , trajectory convergence in finite time, and the ability to compute the exact optimal solution of the problem being modeled, are uncovered and explained in the developed analytical framework.
Keywords :
convex programming; digital circuits; neural nets; quadratic programming; Clarkes generalized gradient; conducting region; constraint neurons; convergence in finite time; convex problem; differential inclusions theory; dynamical behavior; dynamical canonical nonlinear programming circuit; exact optimal solution computing; generalized circuit; generalized neural network; gradient differential inclusions system; linear programming problems; neural-like architecture; nonconvex problem; nonsmooth analysis; nonsmooth nonconvex optimization; nonsmooth nonlinear programming problems; optimization capabilities; quadratic programming problems; real time nonlinear programming problems; salient dynamical features; sliding modes; trajectory convergence infinite time; twice continuously differentiable functions; Analog circuits; Circuit simulation; Computational modeling; Diodes; Dynamic programming; Functional programming; Helium; Neural networks; Neurons; Quadratic programming; Convergence in finite time; gradient inclusions; neural networks; nonlinear programming; nonsmooth nonconvex optimization; sliding modes;
Journal_Title :
Circuits and Systems I: Regular Papers, IEEE Transactions on
DOI :
10.1109/TCSI.2004.834493