Scheduling Shared Scans of Large Data Files

Summary: Studies scheduling scans of large shared data files under many concurrent requests to maximize throughput via aggressive cross-job IO sharing. Proposes a family of sharable-workload policies that deprioritize scans when future sharable demand is high, with simulations on synthetic and real workloads showing gains over SJF baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 9919
Venue: VLDB
Year: 2008
Pagerank: 7.5796338e-05
Overall Rank: 3,270 | 77.57%
DOI: 10.14778/1454159.1454169

Incoming Non-self Citations Over Time

Authors

1. Parag Agrawal (Stanford University)
2. Daniel Kifer (Yahoo)
3. Christopher Olston (Yahoo)

BibTeX Citation

@article{agrawal_vldb08,
        title = {{Scheduling Shared Scans of Large Data Files}},
        author = {Agrawal, Parag and Kifer, Daniel and Olston, Christopher},
        journal = {PVLDB},
        series = {{VLDB} '08},
        volume = {1},
        number = {1},
        pages = {958--969},
        doi = {10.14778/1454159.1454169},
        url = {https://doi.org/10.14778/1454159.1454169},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 8 of 8 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
803	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00013899943
1,401	Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems	2014	SIGMOD	0.00010889902
1,883	ReStore: Reusing Results of MapReduce Jobs	2012	VLDB	9.5421713e-05
2,686	On Improving User Response Times in Tableau	2015	SIGMOD	8.25822e-05
2,887	Efficient Multi-way Theta-Join Processing Using MapReduce	2012	VLDB	7.9952432e-05
7,673	ROBUS: Fair Cache Allocation for Data-parallel Workloads	2017	SIGMOD	5.5705944e-05
12,174	Anti-Combining for MapReduce	2014	SIGMOD	5.093636e-05
12,482	LifeRaft: Data-Driven, Batch Processing for the Exploration of Scientific Databases	2009	CIDR	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
383	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00019520728
761	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.00014254351
1,933	Red Brick Warehouse: A Read-Mostly RDBMS for Open SMP Platforms	1994	SIGMOD	9.4642118e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,256	File Allocation in Distributed Databases with Interaction between Files	1983	VLDB
2	4,001	Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement	2015	VLDB
3	8,679	Efficient Scheduling of Heterogeneous Continuous Queries	2006	VLDB
4	2,337	Multi-dimensional Resource Scheduling for Parallel Queries	1996	SIGMOD
5	696	Main-Memory Scan Sharing For Multi-Core CPUs	2008	VLDB
6	3,046	Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources	1997	VLDB
7	803	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB
8	2,276	Shared Workload Optimization	2014	VLDB
9	3,163	Multi-Query Optimization in MapReduce Framework	2014	VLDB
10	13,581	Job Scheduling with Minimizing Data Communication Costs	2015	SIGMOD