Sibyl: Forecasting Time-Evolving Query Workloads

Summary: Sibyl forecasts time-evolving query workloads, with full statements, across multiple future windows. Template-based featurization plus a stacked-LSTM encoder-decoder handles drift and large windows, delivering 87.3% median F1 and 1.7x/1.3x gains for MV/index selection. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9e16dbb7c47cd60f
Venue: SIGMOD
Year: 2024
Pagerank: 5.5972283e-05
Overall Rank: 7,157 | 51.89%
DOI: 10.1145/3639308

Incoming Non-self Citations Over Time

Authors

1. Hanxian Huang (University of California San Diego)
2. Tarique Siddiqui (Microsoft)
3. Rana Alotaibi (Microsoft)
4. Carlo Curino (Microsoft)
5. Jyoti Leeka (Microsoft)
6. Alekh Jindal (SmartApps)
7. Jishen Zhao (University of California San Diego)
8. Jesús Camacho-Rodríguez (Microsoft)
9. Yuanyuan Tian (Microsoft)

BibTeX Citation

@inproceedings{huang_sigmod24,
        title = {{Sibyl: Forecasting Time-Evolving Query Workloads}},
        author = {Huang, Hanxian and Siddiqui, Tarique and Alotaibi, Rana and Curino, Carlo and Leeka, Jyoti and Jindal, Alekh and Zhao, Jishen and Camacho-Rodríguez, Jesús and Tian, Yuanyuan},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3639308},
        url = {https://dl.acm.org/doi/10.1145/3639308},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,113	Presto’s History-based Query Optimizer	2024	VLDB	5.2276066e-05
10,148	Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries	2025	VLDB	5.0715586e-05
10,290	This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch!	2026	SIGMOD	5.0431863e-05
10,350	Survivorship Bias in Industrial Database Workloads	2026	CIDR	4.9793485e-05
10,751	Toward Drift-Aware Database Benchmarking	2026	VLDB	4.9793485e-05
10,938	Towards Industrial-Scale Parametric Query Optimization	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
88	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035351639
145	Neo: A Learned Query Optimizer	2019	VLDB	0.0002908188
187	DB2 Design Advisor: Integrated Automatic Physical Database Design	2004	VLDB	0.0002592488
224	Self-Driving Database Management Systems	2017	CIDR	0.00024013745
362	Bao: Making Learned Query Optimization Practical	2021	SIGMOD	0.00019989474
379	Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources	2018	SIGMOD	0.00019514689
460	Query-based Workload Forecasting for Self-Driving Database Management Systems	2018	SIGMOD	0.00017842695
861	SnipSuggest: Context-Aware Autocompletion for SQL	2011	VLDB	0.00013402933
1,160	P-Store: An Elastic Database System with Predictive Provisioning	2018	SIGMOD	0.00011769228
1,433	Towards a Learning Optimizer for Shared Clouds	2019	VLDB	0.00010677711
1,745	Selecting Subexpressions to Materialize at Datacenter Scale	2018	VLDB	9.7343818e-05
2,233	Multi-Dimensional Clustering: A New Data Layout Scheme in DB2	2003	SIGMOD	8.7931449e-05
2,834	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9560627e-05
3,545	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2134803e-05
8,872	Tiresias: Enabling Predictive Autonomous Storage and Indexing	2022	VLDB	5.2584643e-05
9,320	CrocodileDB in Action: Resource-Efficient Query Execution by Exploiting Time Slackness	2020	VLDB	5.1946265e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,565	Processing Forecasting Queries	2007	VLDB
2	3,327	Robust Query Driven Cardinality Estimation under Changing Workloads	2023	VLDB
3	3,519	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB
4	5,158	Facilitating SQL Query Composition and Analysis	2020	SIGMOD
5	2,842	Query Performance Prediction for Concurrent Queries using Graph Embedding	2020	VLDB
6	4,059	Database-Agnostic Workload Management	2019	CIDR
7	5,865	Modeling Shifting Workloads for Learned Database Systems	2024	SIGMOD
8	6,783	Database Workload Capacity Planning using Time Series Analysis and Machine Learning	2020	SIGMOD
9	5,194	Database Workload Characterization with Query Plan Encoders	2022	VLDB
10	460	Query-based Workload Forecasting for Self-Driving Database Management Systems	2018	SIGMOD