J4

• • 上一篇    下一篇

高性能网页索引器JU_Indexer的实现

赫枫龄, 左万利, 张雪松   

  1. 吉林大学 计算机科学与技术学院, 长春 130012;吉林大学 符号计算与知识工程教育部重点实验室, 长春 130012
  • 收稿日期:2005-03-24 修回日期:1900-01-01 出版日期:2006-01-26 发布日期:2006-01-26
  • 通讯作者: 左万利

Implementation of a Web Page Indexer JU_Indexer with High Performance

HE Feng-ling, ZUO Wan-li, ZHANG Xue-song   

  1. College of Computer Science and Technology, Jilin University, Changchun 130012, China; Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
  • Received:2005-03-24 Revised:1900-01-01 Online:2006-01-26 Published:2006-01-26
  • Contact: ZUO Wan-li

摘要: 高性能网页索引器JU_Indexer用倒排索引表存储网页索引数据, 以多线程并行的方式对网页建立索引数据, 采用经过优化的检索算法实现用户的查询. 首先给出了JU_Indexer的系统框架, 然后描述了索引数据在JU_Indexer中的存储结构、 建立网页索引的算法、 以及实现用户查询的检索算法. 实验结果表明, JU_Indexer能在毫秒级的时间内完成用户的查询, 它采用的经过优化的词组检索算法缩短了词组的检索时间.

关键词: Web网页, 网络搜索引擎, 网页索引器

Abstract: JU_Indexer, a web page indexer with high performance, uses the inverted index table to store index data for web pages, creates index data by multiple threads concurrently, utilizes the optimized search algorithms to implement the queries posed by users. First, the system architecture of JU_Indexer is given. Then, the data structure used to store the index data in JU_Indexer, the algorithm employed to create web page index, and the strategy utilized to complete the queries proposed by users are described in great detail. The experiment result demonstrates that the queries proposed by users can be completed by JU_Indexer within milliseconds. The optimized phrase search algorithm emplo yed by JU_Indexer shortens the time to complete the phrase querying.

Key words: web pages, Internet search engine, web page indexer

中图分类号: 

  • TP393.09