Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management
Summary: Externalised operator state with explicit primitives enables dynamic scale-out and fault-tolerant recovery for stateful stream processing. Checkpoints are partitioned across new VMs for scale-out; recovery restores state and replays tuples, demonstrated on EC2 with up to 50 VMs and L=350. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Raul Castro Fernandez (Imperial College London)
- 2. Matteo Migliavacca (University of Kent)
- 3. Evangelia Kalyvianaki (Imperial College London)
- 4. Peter Pietzuch (Imperial College London)
BibTeX Citation
@inproceedings{fernandez_sigmod13,
title = {{Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management}},
author = {Fernandez, Raul Castro and Migliavacca, Matteo and Kalyvianaki, Evangelia and Pietzuch, Peter},
series = {{SIGMOD} '13},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/2463676.2465282},
url = {https://dl.acm.org/doi/10.1145/2463676.2465282},
year = {2013}
}Incoming Citations (Sorted by Pagerank)
Showing 40 of 40 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 8 of 8 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 127 | The Design of the Borealis Stream Processing Engine | 2005 | CIDR | 0.00030738755 |
| 150 | Query Processing, Resource Management, and Approximation in a Data Stream Management System | 2003 | CIDR | 0.00029208207 |
| 438 | DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views | 2012 | VLDB | 0.00018471721 |
| 587 | Linear Road: A Stream Data Management Benchmark | 2004 | VLDB | 0.00016106078 |
| 769 | A Comparison of Join Algorithms for Log Processing in MapReduce | 2010 | SIGMOD | 0.00014166872 |
| 2,393 | Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core | 2006 | SIGMOD | 8.6366772e-05 |
| 4,918 | Massive Scale-out of Expensive Continuous Queries | 2011 | VLDB | 6.4469122e-05 |
| 5,035 | Run-Time Operator State Spilling for Memory Intensive Long-Running Queries | 2006 | SIGMOD | 6.3920216e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,851 | Analyzing Efficient Stream Processing on Modern Hardware | 2019 | VLDB |
| 2 | 9,154 | On-Demand State Separation for Cloud Data Warehousing | 2022 | VLDB |
| 3 | 1,209 | Highly Available, Fault-Tolerant, Parallel Dataflows | 2004 | SIGMOD |
| 4 | 6,410 | A Holistic View of Stream Partitioning Costs | 2017 | VLDB |
| 5 | 12,022 | Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance | 2017 | VLDB |
| 6 | 9,460 | Providing Resiliency to Load Variations in Distributed Stream Processing | 2006 | VLDB |
| 7 | 3,776 | Fault-tolerant Stream Processing using a Distributed, Replicated File System | 2008 | VLDB |
| 8 | 11,086 | How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems | 2025 | VLDB |
| 9 | 4,918 | Massive Scale-out of Expensive Continuous Queries | 2011 | VLDB |
| 10 | 1,422 | State Management in Apache Flink: Consistent Stateful Distributed Stream Processing | 2017 | VLDB |