Title :
Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks
Author :
Cheng, Long ; Hou, Zeng-Guang ; Lin, Yingzi ; Tan, Min ; Zhang, Wenjun Chris ; Wu, Fang-Xiang
Author_Institution :
Key Lab. of Complex Syst. & Intell. Sci., Chinese Acad. of Sci., Beijing, China
fDate :
5/1/2011 12:00:00 AM
Abstract :
A recurrent neural network is proposed for solving the non-smooth convex optimization problem with the convex inequality and linear equality constraints. Since the objective function and inequality constraints may not be smooth, the Clarke´s generalized gradients of the objective function and inequality constraints are employed to describe the dynamics of the proposed neural network. It is proved that the equilibrium point set of the proposed neural network is equivalent to the optimal solution of the original optimization problem by using the Lagrangian saddle-point theorem. Under weak conditions, the proposed neural network is proved to be stable, and the state of the neural network is convergent to one of its equilibrium points. Compared with the existing neural network models for non-smooth optimization problems, the proposed neural network can deal with a larger class of constraints and is not based on the penalty method. Finally, the proposed neural network is used to solve the identification problem of genetic regulatory networks, which can be transformed into a non-smooth convex optimization problem. The simulation results show the satisfactory identification accuracy, which demonstrates the effectiveness and efficiency of the proposed approach.
Keywords :
convex programming; genetic algorithms; recurrent neural nets; Clarke generalized gradients; Lagrangian saddle-point theorem; convex inequality; genetic regulatory networks; linear equality; non-smooth convex optimization; recurrent neural network; Artificial neural networks; Convergence; Convex functions; Genetics; Lagrangian functions; Optimization; Recurrent neural networks; Convex; genetic regulatory network; identification; non-smooth optimization problem; recurrent neural network; Algorithms; Animals; Artificial Intelligence; Computational Biology; Computer Simulation; Gene Expression Regulation; Gene Regulatory Networks; Humans; Neural Networks (Computer); Problem Solving;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2011.2109735