• DocumentCode
    1597597
  • Title

    Evaluation of three dimensionality reduction techniques for document classification

  • Author

    Luo, Xiao ; Zincir-Heywood, A. Nur

  • Author_Institution
    Fac. of Comput. Sci., Dalhousie Univ., NS, Canada
  • Volume
    1
  • fYear
    2004
  • Firstpage
    181
  • Abstract
    High dimensional document collections restrict the choice of data processing methods, especially machine learning methods, which need to calculate the inter-vector distances. The paper describes the development and evaluation of three different dimensionality reduction methods for document representation. Specifically, these methods are latent semantic indexing, random mapping and the two combined together. We are interested in how far these dimensionality reduction methods affect accurate measurement of document categorization. The results show that LSI performs better in terms of the F1-measure; however RM+LSI has a very close performance record with a much lower computational cost.
  • Keywords
    classification; computational complexity; data structures; information retrieval; learning (artificial intelligence); self-organising feature maps; text analysis; automated text analysis tools; computational complexity; computational cost; data processing; data representation; dimensionality reduction techniques; document categorization; document classification; document representation; hierarchical self organizing feature map architecture; information retrieval; inter-vector distances; latent semantic indexing; machine learning methods; random mapping; Computational efficiency; Computer science; Data processing; Frequency; Indexing; Large scale integration; Learning systems; Machine learning algorithms; Neural networks; Text analysis;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Electrical and Computer Engineering, 2004. Canadian Conference on
  • ISSN
    0840-7789
  • Print_ISBN
    0-7803-8253-6
  • Type

    conf

  • DOI
    10.1109/CCECE.2004.1344986
  • Filename
    1344986