吉林大学学报(理学版)

• 计算机科学 • 上一篇    下一篇

一种基于规则的无监督词性标注方法

彭涛1, 戴耀康1, 朱枫彤1, 张邦佐2, 刘露1, 闫昭1, 钱锋1   

  1. 1. 吉林大学 计算机科学与技术学院, 长春 130012; 2. 东北师范大学 计算机科学与信息技术学院, 长春 130117
  • 收稿日期:2014-09-24 出版日期:2015-09-26 发布日期:2015-09-29
  • 通讯作者: 闫昭 E-mail:yanzhao@jlu.edu.cn

RuleBased Method for Unsupervised PartofSpeech Tagging

PENG Tao1, DAI Yaokang1, ZHU Fengtong1, ZHANG Bangzuo2, LIU Lu1, YAN Zhao1, QIAN Feng1   

  1. 1. College of Computer Science and Technology, Jilin University, Changchun 130012, China;2. School of Computer Science and Information Technology, Northeast Normal University, Changchun 130117, China
  • Received:2014-09-24 Online:2015-09-26 Published:2015-09-29
  • Contact: YAN Zhao E-mail:yanzhao@jlu.edu.cn

摘要:

提出一种基于规则的无监督词性标注方法, 利用200多条英语语法规则, 创建26个规则函数, 先将输入的待标注英语句子进行预处理后得到初始标记, 再对每个单词调用规则函数, 最终得到标注后的英语句子. 通过对Brown语料库的实验, 词性标注的正确率达到9395%. 实验结果表明, 本文方法可行、 有效, 能很好地提高英语词性标注的准确率.

关键词: 词性标注, 基于规则, 无监督学习, 规则函数

Abstract:

A rulebased tagging method for unsupervised partofspeech was proposed. More than 200 grammar rules were used to create 26 kinds of rules functions. After it was preprocessed, the initial tags of words in the input sentence were obtained, the 26 kinds of rules functions were applied to each word to attain all the tags of the input sentence. Experimental results on Brown corpus show that the accuracy of our method is up to 93.95%, thus, our rulebased method is feasible and effective, and improves the accuracy and the simplicity of English partofspeech tagging.

Key words: partofspeech tagging, rulebased, unsupervised learning, rules function

中图分类号: 

  • TP181