Minimal Echo State Networks for Visualisation

We create an artificial neural network which is a version of echo state machines, ESNs. ESNs are recurrent neural networks but unlike most recurrent networks, they come with an efficient training method. We have previously [17] adapted this method using ideas from neuroscale [15] so that the network is optimal for projecting multivariate time series data onto a low dimensional manifold so that the structure in the time series can be identified by eye. In this paper, we investigate a minimal architecture echo state machine in the context of visualisation and show that it does not perform as well as the original. Using a financial time series, we investigate 3 methods for regaining the power of the standard echo state machine.