Thrifty Query Execution via Incrementability

Summary: Proposes incrementability, a metric to gauge cost-effective incremental view maintenance for queries amid streaming data. Introduces InQP with decomposed control and a cost-model; Spark prototype shows reduced resource use with latency comparable to IVM. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hf9d2c744487ef72b
Venue: SIGMOD
Year: 2020
Pagerank: 5.391109e-05
Overall Rank: 8,137 | 45.32%
DOI: 10.1145/3318464.3389756

Incoming Non-self Citations Over Time

Authors

1. Dixin Tang (University of Chicago)
2. Zechao Shang (University of Chicago)
3. Aaron J. Elmore (University of Chicago)
4. Sanjay Krishnan (University of Chicago)
5. Michael J. Franklin (University of Chicago)

BibTeX Citation

@inproceedings{tang_sigmod20,
        title = {{Thrifty Query Execution via Incrementability}},
        author = {Tang, Dixin and Shang, Zechao and Elmore, Aaron J. and Krishnan, Sanjay and Franklin, Michael J.},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389756},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389756},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,728	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD	5.4649863e-05
8,567	Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI)	2022	SIGMOD	5.3118554e-05
9,073	A Design Space Exploration and Evaluation for Main-Memory Hash Joins in Storage Class Memory	2023	VLDB	5.2258409e-05
9,329	CrocodileDB in Action: Resource-Efficient Query Execution by Exploiting Time Slackness	2020	VLDB	5.1921674e-05
10,173	Transactional Panorama: A Conceptual Framework for User Perception in Analytical Visual Interfaces	2023	VLDB	5.0658661e-05
11,256	Agamotto: Scheduling of Deadline-Oriented Incremental Query Execution under Uncertain Resource Price	2025	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023943337
9	Online Aggregation	1997	SIGMOD	0.00076265429
15	How Good Are Query Optimizers, Really?	2016	VLDB	0.00061067652
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053906051
39	Efficiently Updating Materialized Views	1986	SIGMOD	0.00046583225
62	Maintaining Views Incrementally	1993	SIGMOD	0.00039040346
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034099838
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032445088
144	Neo: A Learned Query Optimizer	2019	VLDB	0.00029090793
388	Incremental Maintenance of Views with Duplicates	1995	SIGMOD	0.00019342096
397	R* Optimizer Validation and Performance Evaluation for Local Queries	1986	SIGMOD	0.00019151375
408	DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views	2012	VLDB	0.00018894165
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014778299
688	Cardinality Estimation Done Right: Index-Based Join Sampling	2017	CIDR	0.00014749318
813	The Dynamic Yannakakis Algorithm: Compact and Efficient Query Processing Under Updates	2017	SIGMOD	0.00013722638
1,030	Rate-Based Query Optimization for Streaming Information Sources	2002	SIGMOD	0.00012402072
1,047	Chain: Operator Scheduling for Memory Minimization in Data Stream Systems	2003	SIGMOD	0.00012303144
1,108	Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources	2003	VLDB	0.00011986214
1,149	Algorithms for Deferred View Maintenance	1996	SIGMOD	0.00011804215
1,160	P-Store: An Elastic Database System with Predictive Provisioning	2018	SIGMOD	0.00011763834
1,465	Pessimistic Cardinality Estimation: Tighter Upper Bounds for Intermediate Join Cardinalities	2019	SIGMOD	0.00010572023
1,780	Lazy Maintenance of Materialized Views	2007	VLDB	9.654014e-05
2,174	A Black-Box Approach to Query Cardinality Estimation	2007	CIDR	8.9193253e-05
2,502	Operator Scheduling in a Data Stream Manager	2003	VLDB	8.3769557e-05
2,801	Supporting Multiple View Maintenance Policies	1997	SIGMOD	7.9878617e-05
3,128	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.611678e-05
4,695	Static Optimization of Conjunctive Queries with Sliding Windows Over Infinite Streams	2004	SIGMOD	6.4632424e-05
5,200	Exact Cardinality Query Optimization with Bounded Execution Cost	2019	SIGMOD	6.2303304e-05
6,032	RPJ: Producing Fast Join Results on Streams through Rate-based Optimization	2005	SIGMOD	5.9077446e-05
6,220	iOLAP: Managing Uncertainty for Efficient Incremental OLAP	2016	SIGMOD	5.8447948e-05
6,801	Intermittent Query Processing	2019	VLDB	5.6776677e-05
6,885	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	5.6546466e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,548	High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance	2024	SIGMOD
2	7,728	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD
3	7,492	Non-Invasive Progressive Optimization for In-Memory Databases	2016	VLDB
4	6,223	Incremental View Maintenance For Collection Programming	2016	PODS
5	10,555	Approximate Query Processing under Updates	2026	SIGMOD
6	4,322	Generalized Scale Independence Through Incremental Precomputation	2013	SIGMOD
7	9,329	CrocodileDB in Action: Resource-Efficient Query Execution by Exploiting Time Slackness	2020	VLDB
8	4,982	An Incremental Anytime Algorithm for Multi-Objective Query Optimization	2015	SIGMOD
9	5,663	Enabling Incremental Query Re-Optimization	2016	SIGMOD
10	6,801	Intermittent Query Processing	2019	VLDB