Title :
Real-time audio-visual calls detection system for a Chicken Robot
Author :
Gribovskiy, Alexey ; Mondada, Francesco
Author_Institution :
Robotic Syst. Lab. 1, Ecole Polytech. Fed. de Lausanne, Lausanne, Switzerland
Abstract :
Design, study, and control of mixed animals-robots societies is the field of scientific exploration that can bring new opportunities for study and control of groups of social animals. In the Chicken Robot project we develop a mobile robot, socially acceptable by chicks and able to interact with them using appropriate communication channels. For interaction purposes the robot has to know positions of all birds in an experimental area and detect those uttering calls. In this paper, we present an audio-visual approach to locate the chicks on a scene and detect their calling activity in real-time. The visual tracking is provided by a marker-based tracker with a help of an overhead camera. Sound localization is achieved by the beamforming approach using an array of sixteen microphones. Visual and sound information are probabilistically mixed to detect the calling activity. The experiments using the e-puck robots instead of the real chicks demonstrate that our system is capable to detect the sound emission activity with more than 90% probability.
Keywords :
array signal processing; audio signal processing; audio-visual systems; microphone arrays; mobile robots; real-time systems; robot vision; telecommunication channels; beamforming approach; calling activity; chicken robot; communication channels; e-puck robots; marker-based tracker; microphones; mixed animals-robots society; mobile robot; real-time audio-visual calls detection system; social animals; sound emission activity; sound localization; visual tracking; Animals; Birds; Cameras; Communication channels; Communication system control; Layout; Microphone arrays; Mobile robots; Real time systems; Robot vision systems;
Conference_Titel :
Advanced Robotics, 2009. ICAR 2009. International Conference on
Conference_Location :
Munich
Print_ISBN :
978-1-4244-4855-5
Electronic_ISBN :
978-3-8396-0035-1