Title :
Comparing NoC architectures for neural networks
Author :
Vainbrand, Dmitri ; Ginosar, Ran
Author_Institution :
Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
Implementation of reconfigurable neural networks in hardware requires highly flexible connectivity, creating major architectural challenge. We perform an analytical evaluation and comparison of different configurable interconnect architectures (mesh NoC, tree, shared bus and point-to-point) emulating variants of two neural network topologies (having full and random exponential configurable connectivity). We derive analytical expressions and asymptotic limits for performance (in terms of bandwidth) and cost (in terms of area and power) of the interconnect architectures considering three communication methods (unicast, multicast and broadcast). It is shown that planar structure, fault and drop tolerance and pulse-information encoding in spiking neural networks makes simple multicast mesh network-on-chip suitable for massively parallel communication required by these networks. Simulation results successfully validate the analytical models and the asymptotic behavior of the network as a function of its size.
Keywords :
encoding; fault tolerance; integrated circuit interconnections; network-on-chip; neural nets; NoC architectures; asymptotic limits; configurable interconnect architectures; drop tolerance; fault tolerance; flexible connectivity; mesh NoC; multicast mesh network-on-chip; neural network topologies; parallel communication; planar structure; pulse-information encoding; reconfigurable neural networks; shared bus; Artificial neural networks; Bandwidth; Delay; Firing; Neurons; Program processors; Unicast;
Conference_Titel :
Electrical and Electronics Engineers in Israel (IEEEI), 2010 IEEE 26th Convention of
Conference_Location :
Eliat
Print_ISBN :
978-1-4244-8681-6
DOI :
10.1109/EEEI.2010.5662130