Focused Crawling Using Context Graphs
Summary: Introduces focused crawling via context graphs modeling link hierarchies and co-occurring content around relevant pages. Combines this model with search-engine reverse-crawling signals for improved credit assignment and substantially higher crawling efficiency. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. M. Diligenti (University of Siena)
- 2. F. M. Coetzee (Nippon Electric Company Research Institute)
- 3. S. Lawrence (Nippon Electric Company Research Institute)
- 4. C. L. Giles (Nippon Electric Company Research Institute)
- 5. M. Gori (University of Siena)
BibTeX Citation
@article{diligenti_vldb00,
title = {{Focused Crawling Using Context Graphs}},
author = {Diligenti, M. and Coetzee, F. M. and Lawrence, S. and Giles, C. L. and Gori, M.},
journal = {PVLDB},
series = {{VLDB} '00},
year = {2000}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 340 | Crawling the Hidden Web | 2001 | VLDB | 0.00020711119 |
| 974 | To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks | 2006 | SIGMOD | 0.00012870746 |
| 5,749 | RankMass Crawler: A Crawler with High Personalized PageRank Coverage Guarantee | 2007 | VLDB | 6.1008193e-05 |
| 8,166 | Accurate and Efficient Crawling for Relevant Websites | 2004 | VLDB | 5.4749372e-05 |
| 8,332 | Sideway Value Algebra for Object-Relational Databases | 2002 | VLDB | 5.4520616e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 1 of 1 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,383 | Distributed Hypertext Resource Discovery Through Examples | 1999 | VLDB | 7.4557297e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 9,683 | Optimal Algorithms for Crawling a Hidden Database in the Web | 2012 | VLDB |
| 2 | 1,483 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB |
| 3 | 1,554 | Google’s Deep-Web Crawl | 2008 | VLDB |
| 4 | 7,532 | The Evolution of the Web and Implications for an Incremental Crawler | 2000 | VLDB |
| 5 | 12,808 | The BINGO! System for Information Portal Generation and Expert Web Search | 2003 | CIDR |
| 6 | 5,749 | RankMass Crawler: A Crawler with High Personalized PageRank Coverage Guarantee | 2007 | VLDB |
| 7 | 340 | Crawling the Hidden Web | 2001 | VLDB |
| 8 | 8,705 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD |
| 9 | 974 | To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks | 2006 | SIGMOD |
| 10 | 8,166 | Accurate and Efficient Crawling for Relevant Websites | 2004 | VLDB |