关键词: 词频-逆文档频率(TF-IDF), 混合聚类, 交叉学科, 基本科学指标数据库(ESI)文献

Abstract: Aiming at the shortcomings of traditional term frequency-inverse document frequency (TF-IDF) algorithm for text classification with specific attributes, especially the low accuracy of words with specific meaning under specific classification, we proposed an improved TF-IDF text clustering algorithm. Comparative experiments were carried out through the papers published by scientific research institutions in Jilin Province from 2015 to 2019. The improved TF-IDF algorithm and the traditional TF-IDF algorithm were used to calculate the frequency of keywords in the papers, then K-means++ method was used to cluster. Finally, random forest algorithm was used to evaluate the accuracy of clustering. The experimental results show that the improved TF-IDF algorithm improves the accuracy of classification.

Key words: term frequency-inverse document frequency (TF-IDF), hybrid clustering, interdisciplinary, essential science indicators (ESI) literature