• DocumentCode
    1594571
  • Title

    High Performance Word-Codeword Mapping Algorithm on PPM

  • Author

    Adiego, Joaquin ; Martinez-Prieto, Migul A. ; Fuente, P.

  • Author_Institution
    Dipt. de Inf., Univ. de Valladolid, Valladolid
  • fYear
    2009
  • Firstpage
    23
  • Lastpage
    32
  • Abstract
    The word-codeword mapping technique allows words to be managed in PPM modelling when a natural language text file is being compressed. The main idea for managing words is to assign them codes in order to improve the compression. The previous work was focused on proposing several mapping adaptive algorithms and evaluating them. In this paper, we propose a semi-static word-codeword mapping method that takes advantage of by previous knowledge of some statistical data of the vocabulary. We test our idea implementing a basic prototype, dubbed mppm2, which also retains all the desirable features of a word-codeword mapping technique. The comparison with other techniques and compressors shows that our proposal is a very competitive choice for compressing natural language texts. In fact, empirical results show that our prototype achieves a very good compression for this type of documents.
  • Keywords
    data compression; natural language processing; statistical analysis; text analysis; PPM modelling; natural language text file; semi-static word-codeword mapping method; statistical data; vocabulary; word-codeword mapping technique; Data compression; Natural Language Modelling; PPM; Text Compression;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Compression Conference, 2009. DCC '09.
  • Conference_Location
    Snowbird, UT
  • ISSN
    1068-0314
  • Print_ISBN
    978-1-4244-3753-5
  • Type

    conf

  • DOI
    10.1109/DCC.2009.40
  • Filename
    4976446