Stability behavior for unsupervised learning

We consider models proposed by Oja, Karhunen, Cox and Adams for a task of unsupervised learning. Questions of existence of solutions and stability behavior of those solutions are addressed. We also discuss the impact of temporary connections in the stability of the learning process.