• DocumentCode
    901983
  • Title

    Subgradient-Based Neural Networks for Nonsmooth Nonconvex Optimization Problems

  • Author

    Bian, Wei ; Xue, Xiaoping

  • Author_Institution
    Dept. of Math., Harbin Inst. of Technol., Harbin
  • Volume
    20
  • Issue
    6
  • fYear
    2009
  • fDate
    6/1/2009 12:00:00 AM
  • Firstpage
    1024
  • Lastpage
    1038
  • Abstract
    This paper presents a subgradient-based neural network to solve a nonsmooth nonconvex optimization problem with a nonsmooth nonconvex objective function, a class of affine equality constraints, and a class of nonsmooth convex inequality constraints. The proposed neural network is modeled with a differential inclusion. Under a suitable assumption on the constraint set and a proper assumption on the objective function, it is proved that for a sufficiently large penalty parameter, there exists a unique global solution to the neural network and the trajectory of the network can reach the feasible region in finite time and stay there thereafter. It is proved that the trajectory of the neural network converges to the set which consists of the equilibrium points of the neural network, and coincides with the set which consists of the critical points of the objective function in the feasible region. A condition is given to ensure the convergence to the equilibrium point set in finite time. Moreover, under suitable assumptions, the coincidence between the solution to the differential inclusion and the ldquoslow solutionrdquo of it is also proved. Furthermore, three typical examples are given to present the effectiveness of the theoretic results obtained in this paper and the good performance of the proposed neural network.
  • Keywords
    gradient methods; neural nets; optimisation; affine equality constraint; nonsmooth convex inequality constraint; nonsmooth nonconvex objective function; nonsmooth nonconvex optimization; subgradient-based neural network; Convergence in finite time; differential inclusion; neural network; nonsmooth nonconvex optimization; slow solution; Algorithms; Computer Simulation; Models, Theoretical; Neural Networks (Computer); Nonlinear Dynamics; Pattern Recognition, Automated;
  • fLanguage
    English
  • Journal_Title
    Neural Networks, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9227
  • Type

    jour

  • DOI
    10.1109/TNN.2009.2016340
  • Filename
    4956970