• DocumentCode
    30626
  • Title

    Optoelectronic Systems Trained With Backpropagation Through Time

  • Author

    Hermans, Michiel ; Dambre, Joni ; Bienstman, Peter

  • Author_Institution
    Dept. of Inf. Technol., Ghent Univ., Ghent, Belgium
  • Volume
    26
  • Issue
    7
  • fYear
    2015
  • fDate
    Jul-15
  • Firstpage
    1545
  • Lastpage
    1550
  • Abstract
    Delay-coupled optoelectronic systems form promising candidates to act as powerful information processing devices. In this brief, we consider such a system that has been studied before in the context of reservoir computing (RC). Instead of viewing the system as a random dynamical system, we see it as a true machine-learning model, which can be fully optimized. We use a recently introduced extension of backpropagation through time, an optimization algorithm originally designed for recurrent neural networks, and use it to let the network perform a difficult phoneme recognition task. We show that full optimization of all system parameters of delay-coupled optoelectronics systems yields a significant improvement over the previously applied RC approach.
  • Keywords
    backpropagation; optical computing; optimisation; optoelectronic devices; recurrent neural nets; speech recognition; RC; backpropagation; delay-coupled optoelectronic system; information processing device; machine-learning model; optimization algorithm; phoneme recognition; recurrent neural network; reservoir computing; Backpropagation; Cost function; Delays; Photonics; Reservoirs; Time series analysis; Training; Backpropagation through time (BPTT); delayed dynamic systems; optical computing; physical neural networks;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2014.2344002
  • Filename
    6879309