MIFO: A Query-Semantic Aware Resource Allocation Policy

Summary: Introduces MIFO, a dataflow-aware scheduler that reduces queue/resource contention by prioritizing near-complete queries. Uses query semantics to trigger proactive allocations; Spark/TPCDS shows 1.2–2.7x speedups and lower makespan vs FAIR, with small fairness tradeoffs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc586bc67b382fbc4
Venue: SIGMOD
Year: 2019
Pagerank: 5.7859508e-05
Overall Rank: 6,435 | 56.74%
DOI: 10.1145/3299869.3319902

Incoming Non-self Citations Over Time

Authors

1. Prajakta Kalmegh (Duke University)
2. Shivnath Babu (Unravel Data Systems)

BibTeX Citation

@inproceedings{kalmegh_sigmod19,
        title = {{MIFO: A Query-Semantic Aware Resource Allocation Policy}},
        author = {Kalmegh, Prajakta and Babu, Shivnath},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319902},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319902},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,772	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	9.6792287e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055406774
31	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00049839909
1,159	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00011771949
1,587	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.0001014156
1,688	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.8645784e-05
6,241	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8381762e-05
6,456	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7782179e-05
8,825	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	5.268646e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,932	Accelerating Complex Analytics using Speculation	2021	CIDR
2	6,112	iQCAR: inter-Query Contention Analyzer for Data Analytics Frameworks	2019	SIGMOD
3	2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD
4	4,392	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB
5	8,376	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD
6	2,225	Shared Workload Optimization	2014	VLDB
7	4,519	Dynamic Resource Brokering for Multi-User Query Execution	1995	SIGMOD
8	8,843	Efficient Scheduling of Heterogeneous Continuous Queries	2006	VLDB
9	3,840	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD
10	10,887	MFTune: An Efficient Multi-fidelity Framework for Spark SQL Configuration Tuning	2026	VLDB