DocumentCode :
3276202
Title :
Real Time Audio-Visual Person Tracking
Author :
Talantzis, Fotios ; Pnevmatikakis, Aristodemos ; Polymenakos, Lazaros C.
Author_Institution :
Autonomic & Grid Comput. Group, Athens Inf. Technol.
fYear :
2006
fDate :
3-6 Oct. 2006
Firstpage :
243
Lastpage :
247
Abstract :
This paper proposes a system for tracking people in three dimensions, utilizing audiovisual information from multiple acoustic and video sensors. The proposed system comprises a video and an audio subsystem combined using a Kalman filter. The video subsystem combines in 3D a number of 2D trackers based on a variation of Stauffer´s adaptive background algorithm with spatio-temporal adaptation of the learning parameters and a Kalman tracker in a feedback configuration. The audio subsystem uses an information theoretic metric upon a pair of microphones to estimate the direction from which sound is arriving from. Combining measurements from a series of pairs the actual coordinate of the speaker in space is derived. Experiments show that gains are to be expected when fusion of the separate tracking systems is performed
Keywords :
Kalman filters; audio-visual systems; image sensors; microphones; real-time systems; spatiotemporal phenomena; tracking; 2D tracker; Kalman filter; Stauffer´s adaptive background algorithm; direction estimation; feedback configuration; information theoretic metric; learning parameter; microphones; multiple acoustic sensors; real time audio-visual person tracking; spatio-temporal adaptation; video sensors; Delay estimation; Direction of arrival estimation; Feedback; Kalman filters; Loudspeakers; Microphones; Multimodal sensors; Sensor systems; Speech; Target tracking; Information Theory; Kalman Filtering; Person Tracking;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Multimedia Signal Processing, 2006 IEEE 8th Workshop on
Conference_Location :
Victoria, BC
Print_ISBN :
0-7803-9751-7
Electronic_ISBN :
0-7803-9752-5
Type :
conf
DOI :
10.1109/MMSP.2006.285306
Filename :
4064556
Link To Document :
بازگشت