Towards continuously learning neural networks

A modular three layer variable structure feedforward network capable of learning by stages is proposed. It consists of a first layer of threshold units, and two subsequent layers of logical gates. The threshold units have a vectorial threshold (instead of a simple scalar), which gives them a spatial reference within the input space. They are trained using the method of centroids, developed by the authors. The modularity of this arrangement allows progressive learning, and the extra units are added as needed, to match the complexity of the problem. The system was tested both with real data and with artificially generated data, to assess its potential. Finally, ways of expanding on the present model are discussed.