Title :
Approximation of sigmoid function and the derivative for hardware implementation of artificial neurons
Author :
Basterretxea, K. ; Tarela, J.M. ; del Campo, I.
Abstract :
A piecewise linear recursive approximation scheme is applied to the computation of the sigmoid function and its derivative in artificial neurons with learning capability. The scheme provides high approximation accuracy with very low memory requirements. The recursive nature of this method allows for the control of the rate accuracy/computation-delay just by modifying one parameter with no impact on the occupied area. The error analysis shows an accuracy comparable to or better than other reported piecewise linear approximation schemes. No multiplier is needed for a digital implementation of the sigmoid generator and only one memory word is required to store the parameter that optimises the approximation.
Keywords :
error analysis; function approximation; interpolation; learning (artificial intelligence); neural chips; piecewise linear techniques; recursive functions; artificial neurons; centred linear approximation; cost-effective implementation; digital neural networks; error analysis; hardware implementation; high approximation accuracy; interpolation method; learning capability; low memory requirements; nonlinear activation function; piecewise linear recursive approximation; sigmoid function approximation; successive vertex smoothing;
Journal_Title :
Circuits, Devices and Systems, IEE Proceedings -
DOI :
10.1049/ip-cds:20030607