Enabling Incremental Query Re-Optimization

Summary: Presents an incremental, cost-based optimizer that re-plans as cost estimates change, with a focus on streaming workloads. Uses recursive Datalog for plan enumeration and pruning, enabling effective incremental re-optimization and applicability to conventional optimizers. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5301
Venue: SIGMOD
Year: 2016
Pagerank: 6.1778488e-05
Overall Rank: 5,552 | 61.91%
DOI: 10.1145/2882903.2915212

Incoming Non-self Citations Over Time

Authors

1. Mengmeng Liu (University of Pennsylvania; Walmart Labs)
2. Zachary G. Ives (University of Pennsylvania)
3. Boon Thau Loo (University of Pennsylvania)

BibTeX Citation

@inproceedings{liu_sigmod16,
        title = {{Enabling Incremental Query Re-Optimization}},
        author = {Liu, Mengmeng and Ives, Zachary G. and Loo, Boon Thau},
        series = {{SIGMOD} '16},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2882903.2915212},
        url = {https://dl.acm.org/doi/10.1145/2882903.2915212},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,469	Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware	2016	VLDB	0.00010678751
7,103	Efficient Adaptive Detection of Complex Event Patterns	2018	VLDB	5.7023779e-05
8,163	Learned Offline Query Planning via Bayesian Optimization	2025	SIGMOD	5.4751517e-05
9,528	CHEX: Multiversion Replay with Ordered Checkpoints	2022	VLDB	5.2549275e-05
10,749	AJOSC: Adaptive Join Order Selection for Continuous Queries	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0024089429
51	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.0004291425
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.00041071971
61	Maintaining Views Incrementally	1993	SIGMOD	0.00039026867
87	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035281619
111	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032990214
128	Efficient and Extensible Algorithms for Multi Query Optimization	2000	SIGMOD	0.0003072825
150	Query Processing, Resource Management, and Approximation in a Data Stream Management System	2003	CIDR	0.00029208207
151	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00029161879
290	An Overview of Query Optimization in Relational Systems	1998	PODS	0.0002227038
492	Robust Query Processing through Progressive Optimization	2004	SIGMOD	0.0001756877
587	Linear Road: A Stream Data Management Benchmark	2004	VLDB	0.00016106078
664	Exploiting Statistics on Query Expressions for Optimization	2002	SIGMOD	0.00015167825
813	Adaptive Ordering of Pipelined Stream Filters	2004	SIGMOD	0.00013846487
1,016	Rate-Based Query Optimization for Streaming Information Sources	2002	SIGMOD	0.00012645699
1,987	Plan Bouquets: Query Processing without Selectivity Estimation	2014	SIGMOD	9.3517129e-05
2,511	Aggregation and Relevance in Deductive Databases	1991	VLDB	8.4854377e-05
2,997	Adapting to Source Properties in Processing Data Integration Queries	2004	SIGMOD	7.8745158e-05
3,097	Evita Raced: Metacompilation for Declarative Networks	2008	VLDB	7.7619658e-05
3,321	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.5216049e-05
4,283	Lifting the Burden of History from Adaptive Query Processing	2004	VLDB	6.7836167e-05
5,222	CliffGuard: A Principled Framework for Finding Robust Database Designs	2015	SIGMOD	6.3103741e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,967	Thrifty Query Execution via Incrementability	2020	SIGMOD
2	4,481	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD
3	11,453	Asymptotically Better Query Optimization Using Indexed Algebra	2023	VLDB
4	5,281	Leveraging Re-costing for Online Optimization of Parameterized Queries with Guarantees	2017	SIGMOD
5	10,296	Succinct Structure Representations for Efficient Query Optimization	2026	SIGMOD
6	1,016	Rate-Based Query Optimization for Streaming Information Sources	2002	SIGMOD
7	289	Optimization of Dynamic Query Evaluation Plans	1994	SIGMOD
8	4,880	An Incremental Anytime Algorithm for Multi-Objective Query Optimization	2015	SIGMOD
9	3,988	Adaptive Query Processing in the Looking Glass	2005	CIDR
10	4,596	Static Optimization of Conjunctive Queries with Sliding Windows Over Infinite Streams	2004	SIGMOD