MIFO: A Query-Semantic Aware Resource Allocation Policy

Summary: Introduces MIFO, a dataflow-aware scheduler that reduces queue/resource contention by prioritizing near-complete queries. Uses query semantics to trigger proactive allocations; Spark/TPCDS shows 1.2–2.7x speedups and lower makespan vs FAIR, with small fairness tradeoffs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc586bc67b382fbc4
Venue: SIGMOD
Year: 2019
Pagerank: 5.7832118e-05
Overall Rank: 6,437 | 56.74%
DOI: 10.1145/3299869.3319902

Incoming Non-self Citations Over Time

Authors

1. Prajakta Kalmegh (Duke University)
2. Shivnath Babu (Unravel Data Systems)

BibTeX Citation

@inproceedings{kalmegh_sigmod19,
        title = {{MIFO: A Query-Semantic Aware Resource Allocation Policy}},
        author = {Kalmegh, Prajakta and Babu, Shivnath},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319902},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319902},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,772	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	9.6746467e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055384955
31	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00049821554
1,158	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00011767292
1,588	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.00010137374
1,688	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.860716e-05
6,243	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8357659e-05
6,458	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7755054e-05
8,834	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	5.2661519e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,938	Accelerating Complex Analytics using Speculation	2021	CIDR
2	6,113	iQCAR: inter-Query Contention Analyzer for Data Analytics Frameworks	2019	SIGMOD
3	2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD
4	4,393	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB
5	8,381	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD
6	2,225	Shared Workload Optimization	2014	VLDB
7	4,520	Dynamic Resource Brokering for Multi-User Query Execution	1995	SIGMOD
8	8,853	Efficient Scheduling of Heterogeneous Continuous Queries	2006	VLDB
9	3,841	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD
10	10,896	MFTune: An Efficient Multi-fidelity Framework for Spark SQL Configuration Tuning	2026	VLDB