• DocumentCode
    1255626
  • Title

    Beat Tracking for Multiple Applications: A Multi-Agent System Architecture With State Recovery

  • Author

    Oliveira, Jose Luis ; Davies, Matthew E P ; Gouyon, Fabien ; Reis, Luís Paulo

  • Author_Institution
    Artificial Intell. & Comput. Sci. Lab. (LIACC), Univ. of Porto (FEUP), Porto, Portugal
  • Volume
    20
  • Issue
    10
  • fYear
    2012
  • Firstpage
    2696
  • Lastpage
    2706
  • Abstract
    In this paper we propose an audio beat tracking system, IBT, for multiple applications. The proposed system integrates an automatic monitoring and state recovery mechanism, that applies (re-)inductions of tempo and beats, on a multi-agent-based beat tracking architecture. This system sequentially processes a continuous onset detection function while propagating parallel hypotheses of tempo and beats. Beats can be predicted in a causal or in a non-causal usage mode, which makes the system suitable for diverse applications. We evaluate the performance of the system in both modes on two application scenarios: standard (using a relatively large database of audio clips) and streaming (using long audio streams made up of concatenated clips). We show experimental evidence of the usefulness of the automatic monitoring and state recovery mechanism in the streaming scenario (i.e., improvements in beat tracking accuracy and reaction time). We also show that the system performs efficiently and at a level comparable to state-of-the-art algorithms in the standard scenario. IBT is multi-platform, open-source and freely available, and it includes plugins for different popular audio analysis, synthesis and visualization platforms.
  • Keywords
    audio streaming; multi-agent systems; multimedia databases; music; object tracking; signal detection; very large databases; IBT; audio analysis; audio beat tracking system; audio clips; audio streaming; audio synthesis; automatic monitoring; concatenated clips; continuous onset detection function; diverse application; large database; multiagent system architecture; parallel hypotheses; state recovery mechanism; visualization; Algorithm design and analysis; Monitoring; Prediction algorithms; Real time systems; Speech; Standards; Timing; Audio beat tracking; beat-synchronous applications; musical rhythm;
  • fLanguage
    English
  • Journal_Title
    Audio, Speech, and Language Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1558-7916
  • Type

    jour

  • DOI
    10.1109/TASL.2012.2210878
  • Filename
    6255768