On the conscious and subconscious components of knowledge representation in neural networks

Principles of learning and knowledge representation are studied in complex neural networks with a large number of parameters. Our neural networks incorporate both deep and shallow knowledge representations. In the case of a stationary environment, the neural nets can develop a deep understanding of the problem and working in a properly chosen, narrow subspace of the system variables. In this functional mode, a small number of parameters dominate the operation of the network on the surface (conscious components), while the overwhelming part of the network operates at the subconscious level. The components realizing the conscious operational task are quite stable, nevertheless, they might change in time if the external environment of the analyzed system varies