I/O-Conscious Data Preparation for Large-Scale Web Search Engines

Summary: I/O-conscious data preparation for external-memory data in large-scale web search engines using coordinated partitioning and delayed batched execution to maximize temporal locality and sequential I/O. Prototype Yuntis shows ~100x speedups over naïve implementations and scales with distributed storage and parallel processing. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 8860
Venue: VLDB
Year: 2002
Pagerank: -
Overall Rank: 13,775 | 4.17%
DOI: -

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Maxim Lifantsev
2. Tzi-cker Chiueh

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
7,374	Sharing Work in Keyword Search over Databases	2011	SIGMOD	4.7494134e-05
7,226	Efficient Search in Very Large Databases	1988	VLDB	4.7953551e-05
2,009	IO-Top-k: Index-access Optimized Top-k Query Processing	2006	VLDB	9.7977564e-05
8,858	Automatic Contention Detection and Amelioration for Data-Intensive Operations	2010	SIGMOD	4.4344518e-05
3,434	Efficient Bulk Insertion into a Distributed Ordered Table	2008	SIGMOD	7.0994919e-05
4,826	Optimizing Result Prefetching in Web Search Engines with Segmented Indices	2002	VLDB	5.8943133e-05
8,150	Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations	2023	VLDB	4.5746638e-05
2,183	Keyword Search on External Memory Data Graphs	2008	VLDB	9.3439219e-05
12,330	Adaptively Parallelizing Distributed Range Queries	2009	VLDB	4.1945683e-05
3,091	Optimized Query Execution in Large Search Engines with Global Page Ordering	2003	VLDB	7.5805947e-05