DBScholar

Back to papers

Run-Time Operator State Spilling for Memory Intensive Long-Running Queries

Summary: Proposes run-time state spilling for memory-heavy, long-running queries with multiple stateful operators; shows inter-operator dependencies necessitating plan-level spill strategies. Introduces bottom-up operator-level spilling and partition-level strategies (local/global output, with penalty), implemented in D-CAPE; experiments favor global-output approaches. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
3826
Venue
SIGMOD
Year
2006
Pagerank
6.3920216e-05
Overall Rank
5,035 | 65.46%
DOI
10.1145/1142473.1142513

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{liu_sigmod06,
        title = {{Run-Time Operator State Spilling for Memory Intensive Long-Running Queries}},
        author = {Liu, Bin and Zhu, Yali and Rundensteiner, Elke A.},
        series = {{SIGMOD} '06},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1142473.1142513},
        url = {https://dl.acm.org/doi/10.1145/1142473.1142513},
        year = {2006}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank Citing Paper Year Venue Pagerank
983 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.0001283214
1,895 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.5260291e-05
3,707 Query Suspend and Resume 2007 SIGMOD 7.1818056e-05
6,528 State-Slice: New Paradigm of Multi-query Optimization of Window-based Stream Queries 2006 VLDB 5.8502273e-05
6,584 E-Cube: Multi-Dimensional Event Sequence Analysis Using Hierarchical Pattern Query Sharing 2011 SIGMOD 5.8354359e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
25 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00054667018
26 Models and Issues in Data Stream Systems 2002 PODS 0.00052982574
98 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034510605
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030738755
193 Continuously Adaptive Continuous Queries over Streams 2002 SIGMOD 0.00025964286
481 Practical Skew Handling in Parallel Joins 1992 VLDB 0.00017780716
671 Load Shedding in a Data Stream Manager 2003 VLDB 0.00015154516
832 Streaming Queries over Streaming Data 2002 VLDB 0.00013736125
904 Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines 1990 VLDB 0.00013319798
1,027 Chain: Operator Scheduling for Memory Minimization in Data Stream Systems 2003 SIGMOD 0.00012563656
1,090 Scalable Distributed Stream Processing 2003 CIDR 0.0001224178
1,093 Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources 2003 VLDB 0.00012218435
1,720 Using Segmented Right-Deep Trees for the Execution of Pipelined Hash Joins 1992 VLDB 9.9265634e-05
2,725 How To Roll a Join: Asynchronous Incremental View Maintenance 2000 SIGMOD 8.2043938e-05
5,728 Shrinking the Warehouse Update Window 1999 SIGMOD 6.1073148e-05
9,269 A Dynamically Adaptive Distributed System for Processing Complex Continuous Queries 2005 VLDB 5.295102e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,018 Dependency-Aware Reordering for Parallelizing Query Optimization in Multi-Core CPUs 2009 SIGMOD
2 1,656 Characterizing Memory Requirements for Queries over Continuous Data Streams 2002 PODS
3 4,918 Massive Scale-out of Expensive Continuous Queries 2011 VLDB
4 9,612 Memory Efficient Scheduling of Query Pipeline Execution 2022 CIDR
5 11,200 High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance 2024 SIGMOD
6 4,596 Static Optimization of Conjunctive Queries with Sliding Windows Over Infinite Streams 2004 SIGMOD
7 6,528 State-Slice: New Paradigm of Multi-query Optimization of Window-based Stream Queries 2006 VLDB
8 3,321 Dynamic Plan Migration for Continuous Queries Over Data Streams 2004 SIGMOD
9 1,027 Chain: Operator Scheduling for Memory Minimization in Data Stream Systems 2003 SIGMOD
10 9,269 A Dynamically Adaptive Distributed System for Processing Complex Continuous Queries 2005 VLDB