• DocumentCode
    899090
  • Title

    Approximation of sigmoid function and the derivative for hardware implementation of artificial neurons

  • Author

    Basterretxea, K. ; Tarela, J.M. ; del Campo, I.

  • Volume
    151
  • Issue
    1
  • fYear
    2004
  • Firstpage
    18
  • Lastpage
    24
  • Abstract
    A piecewise linear recursive approximation scheme is applied to the computation of the sigmoid function and its derivative in artificial neurons with learning capability. The scheme provides high approximation accuracy with very low memory requirements. The recursive nature of this method allows for the control of the rate accuracy/computation-delay just by modifying one parameter with no impact on the occupied area. The error analysis shows an accuracy comparable to or better than other reported piecewise linear approximation schemes. No multiplier is needed for a digital implementation of the sigmoid generator and only one memory word is required to store the parameter that optimises the approximation.
  • Keywords
    error analysis; function approximation; interpolation; learning (artificial intelligence); neural chips; piecewise linear techniques; recursive functions; artificial neurons; centred linear approximation; cost-effective implementation; digital neural networks; error analysis; hardware implementation; high approximation accuracy; interpolation method; learning capability; low memory requirements; nonlinear activation function; piecewise linear recursive approximation; sigmoid function approximation; successive vertex smoothing;
  • fLanguage
    English
  • Journal_Title
    Circuits, Devices and Systems, IEE Proceedings -
  • Publisher
    iet
  • ISSN
    1350-2409
  • Type

    jour

  • DOI
    10.1049/ip-cds:20030607
  • Filename
    1267679