• DocumentCode
    3317640
  • Title

    A dynamic weighted method with support vector machines for Chinese word segmentation

  • Author

    Ren, Feiliang ; Shi, Lei ; Yao, Tianshun

  • Author_Institution
    Natural Language Process. Lab., Northeastern Univ., Shenyang, China
  • fYear
    2005
  • fDate
    30 Oct.-1 Nov. 2005
  • Firstpage
    366
  • Lastpage
    370
  • Abstract
    We explore how a dynamic weighted method with SVM works well for a Chinese word segmentation task. We set up two systems, System1 uses the uniform weight and we take it as our baseline system, System1 uses the dynamic weighted method as we proposed. We compare the performance of the two systems under different experiments conditions, and experiments results show that System2 got an outstanding performance in every condition we tested. It indicates that the dynamic weighted method we proposed has a stronger performance and can be used in many other SVM task such as chunking, POS and so on. At last, we describe a trick that can calculate the segmentation precision ratio and recall ratio for a segmentation task as soon as the end of the training or test process of a SVM procedure at essentially no extra cost.
  • Keywords
    computational linguistics; natural languages; support vector machines; word processing; Chinese word segmentation; SVM; dynamic weighted method; recall ratio; segmentation precision ratio; support vector machines; Costs; Dictionaries; Laboratories; Natural language processing; Natural languages; Software; Support vector machine classification; Support vector machines; System testing; Text categorization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Natural Language Processing and Knowledge Engineering, 2005. IEEE NLP-KE '05. Proceedings of 2005 IEEE International Conference on
  • Print_ISBN
    0-7803-9361-9
  • Type

    conf

  • DOI
    10.1109/NLPKE.2005.1598763
  • Filename
    1598763