Consistency and generalization in incrementally trained connectionist networks

Aspects of consistency and generalization in connectionist networks which learn through incremental training by examples or rules are discussed. Differences between training set learning and incremental rule or example learning are presented. Generalization, the ability to produce reasonable mappings when presented with novel input patterns, is discussed in light of the above learning methods. The contrast between Hamming distance generalization and generalizing by high-order combinations of critical variables is discussed. Examples of detailed rules for an incremental learning model are presented for both consistency and generalization constraints