Algorithms of sparselization based on feedforward neural networks

In order to sparselize feedforward neural networks, “topological sort” and “partial order” are introduced, then a self-constructing learning algorithm and a self-adjusting pruning algorithm are presented. It is necessary to modify existing connections and create new connections. Experimental results show they can prune redundant neurons and connections with good performance