• DocumentCode
    3279092
  • Title

    Refinement of index term set and improvement of classification accuracy on text categorization

  • Author

    Suzuki, Makoto ; Ishida, Takashi ; Goto, Masayuki

  • Author_Institution
    Fac. of Eng., Shonan Inst. of Technol., Fujisawa
  • fYear
    2008
  • fDate
    7-10 Dec. 2008
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    In our previous paper, we proposed a new classification technique called the frequency ratio accumulation method (FRAM). This is a simple technique that adds up the ratios of term frequency among categories. However, in FRAM, the use of index terms is unlimited. Then, we adopt character N-gram as index terms improving the above-described particularity of FRAM. In the present paper, we will refine the DB of the index term set using mutual information and frequency ratio, and improve the classification accuracy. Next, the proposed method is evaluated by performing several experiments. In these experiments, we classify newspaper articles from English Reuters-21578 using FRAM. Reuters-21578 provides benchmark data in automatica text categorization. As a result, we show that it has the good classification accuracy. Specifically, the macro-averaged F-measure of the proposed method is 92.3% for Reuters-21578. Our method is language-independent and provides a new perspective and has excellent potential.
  • Keywords
    pattern classification; text analysis; character N-gram; classification accuracy; frequency ratio accumulation method; index term set refinement; text categorization; Electronic mail; Ferroelectric films; Frequency; Mutual information; Natural languages; Nonvolatile memory; Paper technology; Random access memory; Testing; Text categorization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory and Its Applications, 2008. ISITA 2008. International Symposium on
  • Conference_Location
    Auckland
  • Print_ISBN
    978-1-4244-2068-1
  • Electronic_ISBN
    978-1-4244-2069-8
  • Type

    conf

  • DOI
    10.1109/ISITA.2008.4895455
  • Filename
    4895455