• DocumentCode
    3560615
  • Title

    Audio-Based Objectionable Content Detection Using Discriminative Transforms of Time-Frequency Dynamics

  • Author

    Kim, Myung Jong ; Kim, Hoirin

  • Author_Institution
    Dept. of Electr. Eng., Korea Adv. Inst. of Sci. & Technol., Daejeon, South Korea
  • Volume
    14
  • Issue
    5
  • fYear
    2012
  • Firstpage
    1390
  • Lastpage
    1400
  • Abstract
    In this paper, the problem of detecting objectionable sounds, such as sexual screaming or moaning, to classify and block objectionable multimedia content is addressed. Objectionable sounds show distinctive characteristics, such as large temporal variations and fast spectral transitions, which are different from general audio signals, such as speech and music. To represent these characteristics, segment-based two-dimensional Mel-frequency cepstral coefficients and histograms of gradient directions are used as a feature set to characterize the time-frequency dynamics within a long-range segment of the target signal. After extracting the features, they are transformed to features with lower dimensions while preserving discriminative information using linear discriminant analysis based on a combination of global and local Fisher criteria. A Gaussian mixture model is adopted to statistically represent objectionable and non-objectionable sounds, and test sounds are classified by using a likelihood ratio test. Evaluation of the proposed feature extraction method on a database of several hundred objectionable and non-objectionable sound clips yielded precision/recall breakeven point of 91.25%, which is a promising performance which shows that the system can be applied to help an image-based approach to block such multimedia content.
  • Keywords
    Gaussian processes; audio signal processing; cepstral analysis; content management; feature extraction; gradient methods; image classification; image representation; image segmentation; multimedia computing; object detection; statistical analysis; time-frequency analysis; wavelet transforms; Fisher criteria; Gaussian mixture model; HOG; audio signal classification; audio-based objectionable content detection; discriminative information; discriminative transform; feature extraction; histograms of gradient; image-based approach; likelihood ratio test; linear discriminant analysis; multimedia content; segment-based 2D Mel-frequency cepstral coefficient; statistical object representation; time-frequency dynamics; Feature extraction; Materials; Multimedia communication; Music; Speech; Time frequency analysis; Transforms; Discriminative transforms; histograms of oriented gradients; objectionable sound detection; segmental two-dimensional Mel-frequency cepstral coefficients;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • Conference_Location
    4/19/2012 12:00:00 AM
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2012.2195481
  • Filename
    6187733