• DocumentCode
    2592034
  • Title

    Intelligent human-machine interface using hand gestures recognition

  • Author

    Oniga, Stefan ; Vegh, János ; Orha, Ioan

  • Author_Institution
    Inf. Syst. & Networks Dept., Univ. of Debrecen, Debrecen, Hungary
  • fYear
    2012
  • fDate
    24-27 May 2012
  • Firstpage
    559
  • Lastpage
    563
  • Abstract
    Due to the rapid increase of number of industrial or domestic systems that must be controlled it is clear that new, more natural methods of control are needed. This paper presents an intelligent human machine interface based on hand´s gesture recognition. The gestures based control system is composed by two subsystems that communicated via radio waves. The first subsystem is a bracelet that captures the movement of the hand using accelerometers. The second subsystem is the control box on which the data processing takes place. Artificial Neural Networks (ANN) are used to add learning capabilities and adaptive behavior to intelligent interfaces that can be used even by elderly or impaired people. Field Programmable Gate Array (FPGA) implementation is an easy an attractive way for hardware implementation. The desired network is modeled, trained and simulated using Neural Network Toolbox. Many networks architecture trained with different methods could be simulated and the network that is best performing for given application is chosen for hardware implementation using System Generator tool developed by Xilinx Inc. This also allows the easy generation of Hardware Description Language (HDL) code from the system representation in Simulink. This HDL design can then be synthesized for implementation in the Xilinx family of FPGA devices.
  • Keywords
    accelerometers; computerised instrumentation; control engineering computing; field programmable gate arrays; gesture recognition; hardware description languages; human computer interaction; interactive devices; learning (artificial intelligence); logic design; neural net architecture; radio networks; ANN; FPGA implementation; HDL code; HDL design; Simulink; Xilinx family; accelerometers; artificial neural networks; bracelet; control box; data processing; domestic system; elderly people; field programmable gate arrays; gesture based control system; hand gesture recognition; hand movement captures; hardware description language; impaired people; industrial system; intelligent human machine interface; learning capabilities; networks architecture; neural network toolbox; radiowave communication; system generator tool; system representation; Artificial neural networks; Biological neural networks; Field programmable gate arrays; Gesture recognition; Hardware; Mathematical model; Neurons; Artificial Neural Networks; Field Programmable Gate Arrays; Gesture recognition; Human-Machine Interface;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Automation Quality and Testing Robotics (AQTR), 2012 IEEE International Conference on
  • Conference_Location
    Cluj-Napoca
  • Print_ISBN
    978-1-4673-0701-7
  • Type

    conf

  • DOI
    10.1109/AQTR.2012.6237773
  • Filename
    6237773