MIFO: A Query-Semantic Aware Resource Allocation Policy

Summary: Introduces MIFO, a dataflow-aware scheduler that reduces queue/resource contention by prioritizing near-complete queries. Uses query semantics to trigger proactive allocations; Spark/TPCDS shows 1.2–2.7x speedups and lower makespan vs FAIR, with small fairness tradeoffs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5776
Venue: SIGMOD
Year: 2019
Pagerank: 5.8932222e-05
Overall Rank: 6,375 | 56.27%
DOI: 10.1145/3299869.3319902

Incoming Non-self Citations Over Time

Authors

1. Prajakta Kalmegh (Duke University)
2. Shivnath Babu (Unravel Data Systems)

BibTeX Citation

@inproceedings{kalmegh_sigmod19,
        title = {{MIFO: A Query-Semantic Aware Resource Allocation Policy}},
        author = {Kalmegh, Prajakta and Babu, Shivnath},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319902},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319902},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,863	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	9.5950349e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
32	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00050111008
1,143	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00011999403
1,562	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.00010354429
1,665	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	0.00010069173
6,138	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.9640712e-05
6,333	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.9094287e-05
8,668	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	5.3882971e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	696	Main-Memory Scan Sharing For Multi-Core CPUs	2008	VLDB
2	11,625	Accelerating Complex Analytics using Speculation	2021	CIDR
3	6,082	iQCAR: inter-Query Contention Analyzer for Data Analytics Frameworks	2019	SIGMOD
4	3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD
5	4,330	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB
6	8,237	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD
7	2,276	Shared Workload Optimization	2014	VLDB
8	4,462	Dynamic Resource Brokering for Multi-User Query Execution	1995	SIGMOD
9	8,679	Efficient Scheduling of Heterogeneous Continuous Queries	2006	VLDB
10	3,783	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD