Experimental determination of the capacity of the 5-ary Adaline

The purpose of this work is to examine the effect of limited precision weights on the capacity of the threshold Adaline. The binary and the ternary Adalines are examples of limited precision Adalines for which the values of the weights are restricted to {+1, -1} and {+1, 0, -1} respectively. The 5-ary Adaline is also an example of the threshold Adaline where the weights are restricted to five levels, {-2, -1, 0, 1, 2}. The capacity of the binary Adaline is approximately 0.83; the capacity of the ternary Adaline is approximately 1.16 and the capacity of the real-valued Adaline is 2. Thus the capacity of the 5-ary Adaline is expected to have a value between 1.16 and 2. The experimental results presented in this paper indicate that the capacity of the 5-ary Adaline is approximately 1.51