Job Scheduling with Minimizing Data Communication Costs

Summary: Proposes data-aware scheduling of interdependent jobs to minimize makespan under data-communication costs in distributed file systems like HDFS. Evaluates algorithms that trade data locality for parallelism while honoring input dependencies in query plans. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5153
Venue: SIGMOD
Year: 2015
Pagerank: -
Overall Rank: 13,581 | 6.83%
DOI: 10.1145/2723372.2764943

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Trevor Clinkenbeard (University of Waterloo)
2. Anisoara Nica (SAP)

BibTeX Citation

@inproceedings{clinkenbeard_sigmod15,
        title = {{Job Scheduling with Minimizing Data Communication Costs}},
        author = {Clinkenbeard, Trevor and Nica, Anisoara},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2764943},
        url = {https://dl.acm.org/doi/10.1145/2723372.2764943},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,068	Scheduling Problems in Parallel Query Optimization	1995	PODS
2	1,299	A Low Communication Sort Algorithm for a Parallel Database Machine	1989	VLDB
3	2,131	Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism	1994	VLDB
4	2,539	Minimal MapReduce Algorithms	2013	SIGMOD
5	5,052	Distributed implementations of dependency discovery algorithms	2019	VLDB
6	12,001	Runtime Optimization of Join Location in Parallel Data Management Systems	2017	VLDB
7	1,514	Upper and Lower Bounds on the Cost of a Map-Reduce Computation	2013	VLDB
8	3,163	Multi-Query Optimization in MapReduce Framework	2014	VLDB
9	3,046	Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources	1997	VLDB
10	3,270	Scheduling Shared Scans of Large Data Files	2008	VLDB