Presto’s History-based Query Optimizer

Summary: Records execution histories to predict intermediate cardinalities and operator costs for complex query shapes, replacing brittle analytic estimators. Lightweight, adaptive HBO uses a Redis-backed statistics store to optimize similar future queries and is production-deployed at Meta and Uber. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13795
Venue: VLDB
Year: 2024
Pagerank: 5.093636e-05
Overall Rank: 11,290 | 22.55%
DOI: 10.14778/3685800.3685828

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Pranjal Shankhdhar (Meta)
2. Feilong Liu (Meta)
3. Jay Narale (Uber)
4. James Sun (Meta)
5. Rebecca Schlussel (Meta)
6. Lyublena Antova (Meta)

BibTeX Citation

@article{shankhdhar_vldb24,
        title = {{Presto’s History-based Query Optimizer}},
        author = {Shankhdhar, Pranjal and Liu, Feilong and Narale, Jay and Sun, James and Schlussel, Rebecca and Antova, Lyublena},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {12},
        pages = {4077--4089},
        doi = {10.14778/3685800.3685828},
        url = {https://doi.org/10.14778/3685800.3685828},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059284255
32	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00050111008
154	Neo: A Learned Query Optimizer	2019	VLDB	0.00028726181
257	The History of Histograms (abridged)	2003	VLDB	0.00023154793
365	STHoles: A Multidimensional Workload-Aware Histogram	2001	SIGMOD	0.00020041735
378	Bao: Making Learned Query Optimization Practical	2021	SIGMOD	0.00019638121
694	Cardinality Estimation Done Right: Index-Based Join Sampling	2017	CIDR	0.00014911698
1,061	Are We Ready For Learned Cardinality Estimation?	2021	VLDB	0.00012369764
1,122	Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation	2022	VLDB	0.0001209124
1,503	Self-Tuning, GPU-Accelerated Kernel Density Models for Multidimensional Selectivity Estimation	2015	SIGMOD	0.000105564
1,621	Orca: A Modular Query Optimizer Architecture for Big Data	2014	SIGMOD	0.00010203114
2,078	Query Optimization in Microsoft SQL Server PDW	2012	SIGMOD	9.2078209e-05
2,543	Learned Cardinality Estimation: An In-depth Study	2022	SIGMOD	8.4445934e-05
2,723	Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation	2022	VLDB	8.2049453e-05
2,844	Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction	2022	VLDB	8.0608767e-05
2,991	FactorJoin: A New Cardinality Estimation Framework for Join Queries	2023	SIGMOD	7.8880723e-05
3,093	Statistics on Views	2003	VLDB	7.7664764e-05
4,635	Optimizer Plan Change Management: Improved Stability and Performance in Oracle 11g	2008	VLDB	6.5928815e-05
4,700	Cost Models DO Matter: Providing Cost Information for Diverse Data Sources in a Federated System	1999	VLDB	6.5557492e-05
4,705	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.5529421e-05
4,929	AutoSteer: Learned Query Optimization for Any SQL Database	2023	VLDB	6.4423294e-05
5,514	StatAdvisor: Recommending Statistical Views	2009	VLDB	6.1901666e-05
7,580	Sibyl: Forecasting Time-Evolving Query Workloads	2024	SIGMOD	5.5925285e-05
9,283	Intelligent Automated Workload Analysis for Database Replatforming	2022	SIGMOD	5.2925877e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,920	Still Asking: How Good Are Query Optimizers, Really?	2025	VLDB
2	4,705	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD
3	1,256	Sampling-Based Query Re-Optimization	2016	SIGMOD
4	4,880	An Incremental Anytime Algorithm for Multi-Objective Query Optimization	2015	SIGMOD
5	5,281	Leveraging Re-costing for Online Optimization of Parameterized Queries with Guarantees	2017	SIGMOD
6	4,481	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD
7	2,762	Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection	2022	VLDB
8	5,124	Approximation Schemes for Many-Objective Query Optimization	2014	SIGMOD
9	2,078	Query Optimization in Microsoft SQL Server PDW	2012	SIGMOD
10	566	Towards a Robust Query Optimizer: A Principled and Practical Approach	2005	SIGMOD