J4
• 计算机科学 • Previous Articles Next Articles
HE Feng-ling, ZUO Wan-Li
Received:
Revised:
Online:
Published:
Contact:
Abstract: The present paper deals with the technique how to solve the problem of cycle links in internet crawling by directed graph. First, the problem is proposed. Then, the formal definition of cycle links in internet crawling is described. Finally, the algorithm to solve the problem by directed graph is given. The key problem to a crawler is how to find directed loops effectively in web pages crawled by the crawler. The algorithm described in this paper can make the crawler avoid dropping in the pitfall created by cycle links.
Key words: crawler, internet search engine, hyperlink, directed graph
CLC Number:
HE Feng-ling, ZUO Wan-Li. Solve the cycle links problem in Internet crawlingby directe d graph[J].J4, 2004, 42(03): 402-404.
0 / / Recommend
Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks
URL: http://xuebao.jlu.edu.cn/lxb/EN/
http://xuebao.jlu.edu.cn/lxb/EN/Y2004/V42/I03/402
Cited