Dealing with Web Data: History and Look ahead

Summary: A decade-later retrospective on incremental Web crawling at extreme scale and volatility. Reexamines the counterintuitive result that prioritizing frequently changing pages may not maximize freshness, and outlines emerging challenges for search engines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 10352
Venue: VLDB
Year: 2010
Pagerank: -
Overall Rank: 13,726 | 5.83%
DOI: 10.14778/1920841.1920846

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Junghoo Cho (University of California Los Angeles)
2. Hector Garcia-Molina (Stanford University)

BibTeX Citation

@article{cho_vldb10,
        title = {{Dealing with Web Data: History and Look ahead}},
        author = {Cho, Junghoo and Garcia-Molina, Hector},
        journal = {PVLDB},
        series = {{VLDB} '10},
        volume = {3},
        number = {1},
        doi = {10.14778/1920841.1920846},
        url = {https://doi.org/10.14778/1920841.1920846},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
7,532	The Evolution of the Web and Implications for an Incremental Crawler	2000	VLDB	5.6029996e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,851	Database Issues for the 21st century	2005	SIGMOD
2	3,725	Finding replicated web collections	2000	SIGMOD
3	8,166	Accurate and Efficient Crawling for Relevant Websites	2004	VLDB
4	2,096	An Analysis of Structured Data on the Web	2012	VLDB
5	12,426	Optimizing Content Freshness of Relations Extracted From the Web Using Keyword Search	2010	SIGMOD
6	13,788	Databases on the Web	2007	SIGMOD
7	3,815	Longitudinal Analytics on Web Archive Data: It's About Time!	2011	CIDR
8	14,213	Future Directions and Research Problems in the World Wide Web	1996	PODS
9	9,683	Optimal Algorithms for Crawling a Hidden Database in the Web	2012	VLDB
10	7,532	The Evolution of the Web and Implications for an Incremental Crawler	2000	VLDB