Title :
Towards a situated, multimodal interface for multiple UAV control
Author :
Jones, Geraint ; Berthouze, Nadia ; Bielski, Roman ; Julie, Simon
Author_Institution :
Dept. of Comput. Sci., Univ. Coll. London, London, UK
Abstract :
Multiple autonomous Unmanned Aerial Vehicles (UAVs) can be used to complement human teams. This paper presents the results of an exploratory study to investigate gesture/speech interfaces for interaction with robots in a situated manner and the development of three iterations of a prototype command set. A command set was compiled from observing users interacting with a simulated interface in a virtual reality environment. We discovered that users find this type of interface intuitive and their commands tend to naturally group into both `High-Level´ and `Low-Level´ instructions. However, as the robots moved further away, the loss of depth perception and direct feedback was inimical to the interaction. In a second experiment we found that using simple heads up display elements could mitigate these issues.
Keywords :
gesture recognition; human-robot interaction; mobile robots; remotely operated vehicles; space vehicles; speech-based user interfaces; telerobotics; virtual reality; autonomous unmanned aerial vehicles; gesture interface; heads up display elements; high level instruction; iteration methods; low level instruction; multimodal interface; multiple UAV control; prototype command set; speech interface; virtual reality; Cognitive robotics; Control systems; Feedback; Humans; Mobile robots; Remotely operated vehicles; Robot sensing systems; Speech; Unmanned aerial vehicles; Virtual reality;
Conference_Titel :
Robotics and Automation (ICRA), 2010 IEEE International Conference on
Conference_Location :
Anchorage, AK
Print_ISBN :
978-1-4244-5038-1
Electronic_ISBN :
1050-4729
DOI :
10.1109/ROBOT.2010.5509960