Title :
Beat Tracking for Multiple Applications: A Multi-Agent System Architecture With State Recovery
Author :
Oliveira, Jose Luis ; Davies, Matthew E P ; Gouyon, Fabien ; Reis, Luís Paulo
Author_Institution :
Artificial Intell. & Comput. Sci. Lab. (LIACC), Univ. of Porto (FEUP), Porto, Portugal
Abstract :
In this paper we propose an audio beat tracking system, IBT, for multiple applications. The proposed system integrates an automatic monitoring and state recovery mechanism, that applies (re-)inductions of tempo and beats, on a multi-agent-based beat tracking architecture. This system sequentially processes a continuous onset detection function while propagating parallel hypotheses of tempo and beats. Beats can be predicted in a causal or in a non-causal usage mode, which makes the system suitable for diverse applications. We evaluate the performance of the system in both modes on two application scenarios: standard (using a relatively large database of audio clips) and streaming (using long audio streams made up of concatenated clips). We show experimental evidence of the usefulness of the automatic monitoring and state recovery mechanism in the streaming scenario (i.e., improvements in beat tracking accuracy and reaction time). We also show that the system performs efficiently and at a level comparable to state-of-the-art algorithms in the standard scenario. IBT is multi-platform, open-source and freely available, and it includes plugins for different popular audio analysis, synthesis and visualization platforms.
Keywords :
audio streaming; multi-agent systems; multimedia databases; music; object tracking; signal detection; very large databases; IBT; audio analysis; audio beat tracking system; audio clips; audio streaming; audio synthesis; automatic monitoring; concatenated clips; continuous onset detection function; diverse application; large database; multiagent system architecture; parallel hypotheses; state recovery mechanism; visualization; Algorithm design and analysis; Monitoring; Prediction algorithms; Real time systems; Speech; Standards; Timing; Audio beat tracking; beat-synchronous applications; musical rhythm;
Journal_Title :
Audio, Speech, and Language Processing, IEEE Transactions on
DOI :
10.1109/TASL.2012.2210878