Enabling Incremental Query Re-Optimization

Summary: Presents an incremental, cost-based optimizer that re-plans as cost estimates change, with a focus on streaming workloads. Uses recursive Datalog for plan enumeration and pruning, enabling effective incremental re-optimization and applicability to conventional optimizers. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: ha345d1812d94435a
Venue: SIGMOD
Year: 2016
Pagerank: 6.0448133e-05
Overall Rank: 5,663 | 61.94%
DOI: 10.1145/2882903.2915212

Incoming Non-self Citations Over Time

Authors

1. Mengmeng Liu (University of Pennsylvania; Walmart Labs)
2. Zachary G. Ives (University of Pennsylvania)
3. Boon Thau Loo (University of Pennsylvania)

BibTeX Citation

@inproceedings{liu_sigmod16,
        title = {{Enabling Incremental Query Re-Optimization}},
        author = {Liu, Mengmeng and Ives, Zachary G. and Loo, Boon Thau},
        series = {{SIGMOD} '16},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2882903.2915212},
        url = {https://dl.acm.org/doi/10.1145/2882903.2915212},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,473	Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware	2016	VLDB	0.00010552993
7,251	Efficient Adaptive Detection of Complex Event Patterns	2018	VLDB	5.5719214e-05
7,546	Learned Offline Query Planning via Bayesian Optimization	2025	SIGMOD	5.4966669e-05
9,718	CHEX: Multiversion Replay with Ordered Checkpoints	2022	VLDB	5.1345893e-05
11,184	AJOSC: Adaptive Join Order Selection for Continuous Queries	2025	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023943337
49	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.0004314366
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.000408505
62	Maintaining Views Incrementally	1993	SIGMOD	0.00039040346
88	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035340164
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032445088
129	Efficient and Extensible Algorithms for Multi Query Optimization	2000	SIGMOD	0.00030395767
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028977821
152	Query Processing, Resource Management, and Approximation in a Data Stream Management System	2003	CIDR	0.00028657752
272	An Overview of Query Optimization in Relational Systems	1998	PODS	0.0002251422
471	Robust Query Processing through Progressive Optimization	2004	SIGMOD	0.00017744392
594	Linear Road: A Stream Data Management Benchmark	2004	VLDB	0.00015816384
644	Exploiting Statistics on Query Expressions for Optimization	2002	SIGMOD	0.00015209065
827	Adaptive Ordering of Pipelined Stream Filters	2004	SIGMOD	0.00013629035
1,030	Rate-Based Query Optimization for Streaming Information Sources	2002	SIGMOD	0.00012402072
1,989	Plan Bouquets: Query Processing without Selectivity Estimation	2014	SIGMOD	9.2469024e-05
2,551	Aggregation and Relevance in Deductive Databases	1991	VLDB	8.3057709e-05
2,989	Adapting to Source Properties in Processing Data Integration Queries	2004	SIGMOD	7.7736772e-05
3,142	Evita Raced: Metacompilation for Declarative Networks	2008	VLDB	7.595954e-05
3,371	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.3659127e-05
4,369	Lifting the Burden of History from Adaptive Query Processing	2004	VLDB	6.6302169e-05
5,310	CliffGuard: A Principled Framework for Finding Robust Database Designs	2015	SIGMOD	6.184026e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,137	Thrifty Query Execution via Incrementability	2020	SIGMOD
2	4,069	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD
3	11,771	Asymptotically Better Query Optimization Using Indexed Algebra	2023	VLDB
4	5,081	Leveraging Re-costing for Online Optimization of Parameterized Queries with Guarantees	2017	SIGMOD
5	10,519	Succinct Structure Representations for Efficient Query Optimization	2026	SIGMOD
6	1,030	Rate-Based Query Optimization for Streaming Information Sources	2002	SIGMOD
7	288	Optimization of Dynamic Query Evaluation Plans	1994	SIGMOD
8	4,982	An Incremental Anytime Algorithm for Multi-Objective Query Optimization	2015	SIGMOD
9	4,046	Adaptive Query Processing in the Looking Glass	2005	CIDR
10	4,695	Static Optimization of Conjunctive Queries with Sliding Windows Over Infinite Streams	2004	SIGMOD