Title :
A Hardware-Efficient Sigmoid Function With Adjustable Precision for a Neural Network System
Author :
Chang-Hung Tsai ; Yu-Ting Chih ; Wing Hung Wong ; Chen-Yi Lee
Author_Institution :
Dept. of Electron. Eng., Nat. Chiao Tung Univ., Hsinchu, Taiwan
Abstract :
A hardware-efficient sigmoid function calculator with adjustable precision for neural network and deep-learning applications is proposed in this brief. By adopting the bit-plane format of the input and output values, the computational latency of the processing time can be dynamically reduced according to the user configuration. To reduce the hardware cost, the coefficients used to calculate the sigmoid value can be shared for multiple calculators without any structural hazard. In addition, the restricted constraint is applied in the coefficients´ training stage to further simplify the computation in the calculation stage with a negligible quality loss. A test module is designed for the proposal and operated at 300 MHz to achieve 75 million sigmoid calculations per second. Implemented in 90-nm CMOS technology, the core of the calculator costs 1663 gates, and a 1-kb globally shared memory is used to store the coefficients.
Keywords :
CMOS integrated circuits; electronic calculators; learning (artificial intelligence); neural nets; CMOS technology; bit-plane format; computational latency; deep-learning applications; frequency 300 MHz; globally shared memory; hardware cost; hardware-efficient sigmoid function calculator; neural network; processing time; restricted constraint; sigmoid value; size 90 nm; training stage; Biological neural networks; Calculators; Hardware; Neurons; Table lookup; Training; Adjustable Precision; Adjustable precision; Deep Learning; Hardware-Efficient; Neural Network; Sigmoid Function; deep learning; hardware efficient; neural network; sigmoid function;
Journal_Title :
Circuits and Systems II: Express Briefs, IEEE Transactions on
DOI :
10.1109/TCSII.2015.2456531
