A study on the partitioning capabilities of two-layer neural networks

Recent studies indicate that neural networks with a single hidden layer can implement both nonconvex and disconnected decision regions. In this paper, we examine the capabilities of neural nets to implement more complex decision regions such as nested decision regions. We study two-class problems with four, five and six nested decision regions and demonstrate that single hidden-layer nets can in fact implement these complex structures