Unsupervised clustering of ambulatory audio and video

Author

Clarkson, Brian ; Pentland, Alex

Author_Institution

Media Lab., MIT, Cambridge, MA, USA

Volume

6

fYear

1999

fDate

15-19 Mar 1999

Firstpage

3037

Abstract

A truly personal and reactive computer system should have access to the same information as its user, including the ambient sights and sounds. To this end, we have developed a system for extracting events and scenes from natural audio/visual input. We find our system can (without any prior labeling of data) cluster the audio/visual data into events, such as passing through doors and crossing the street. Also, we hierarchically cluster these events into scenes and get clusters that correlate with visiting the supermarket, or walking down a busy street

Keywords

audio signal processing; feature extraction; pattern clustering; portable computers; video signal processing; ambient sights; ambient sounds; ambulatory audio; ambulatory video; audio/visual data; audio/visual input; correlation; doors; personal computer system; reactive computer system; street; supermarket; unsupervised clustering; wearable computer systems; Cameras; Data mining; Indexing; Intelligent agent; Labeling; Layout; Legged locomotion; Microphones; Video recording; Wearable computers;

fLanguage

English

Publisher

ieee

Conference_Titel

Acoustics, Speech, and Signal Processing, 1999. Proceedings., 1999 IEEE International Conference on

Conference_Location

Phoenix, AZ

ISSN

1520-6149

Print_ISBN

0-7803-5041-3

Type

conf

DOI

10.1109/ICASSP.1999.757481

Filename

757481