关键词: 中文信息处理, 中文自动分词, 后缀数组, 散列表

Abstract: An automatic and dictionary-free Chinese word segmentation method based on suffix array algorithm is proposed. By the algorithm based on suffix array and by using HashMap the co-occurrence patterns of Chinese characters are gotten, and Chinese words are filtered through confidence. Experiment results show that by the algorithm one can acquire high frequency lexical items effectively and efficiently without the help of the dictionary and corpus as well. This method is particularly suitable for lexical-frequency-sensitive as well as time-critical Chinese information processing application.

Key words: Chinese information processing, automatic Chinese word segmentation, suffix array, HashMap