State Management in Apache Flink: Consistent Stateful Distributed Stream Processing
Summary: Apache Flink introduces asynchronous, pipelined in-flight snapshots for lightweight, consistent distributed state capture without halting stream processing. Explicit state enables partitioning, transparent persistence, fault recovery, reconfiguration, versioning, external queries, and output commits with low overhead. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Paris Carbone (Royal Institute of Technology)
- 2. Seif Haridi (Royal Institute of Technology)
- 3. Stephan Ewen (data Artisans)
- 4. Stefan Richter (data Artisans)
- 5. Gyula Fóra (King Digital Entertainment Limited)
- 6. Kostas Tzoumas (data Artisans)
BibTeX Citation
@article{carbone_vldb17,
title = {{State Management in Apache Flink: Consistent Stateful Distributed Stream Processing}},
author = {Carbone, Paris and Haridi, Seif and Ewen, Stephan and Richter, Stefan and Fóra, Gyula and Tzoumas, Kostas},
journal = {PVLDB},
series = {{VLDB} '17},
volume = {10},
number = {12},
pages = {1718--1729},
doi = {10.14778/3137765.3137777},
url = {https://doi.org/10.14778/3137765.3137777},
year = {2017}
}Incoming Citations (Sorted by Pagerank)
Showing 31 of 31 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 20 | Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud | 2012 | VLDB | 0.00056944564 |
| 224 | MillWheel: Fault-Tolerant Stream Processing at Internet Scale | 2013 | VLDB | 0.00024130894 |
| 361 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB | 0.00020138717 |
| 505 | TelegraphCQ: Continuous Dataflow Processing | 2003 | SIGMOD | 0.00017285498 |
| 983 | Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management | 2013 | SIGMOD | 0.0001283214 |
| 1,090 | Scalable Distributed Stream Processing | 2003 | CIDR | 0.0001224178 |
| 4,278 | Consistent Regions: Guaranteed Tuple Processing in IBM Streams | 2016 | VLDB | 6.7871785e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 8,874 | Stateful Entities: Object-oriented Cloud Applications as Distributed Dataflows | 2023 | CIDR |
| 2 | 6,482 | AStream: Ad-hoc Shared Stream Processing | 2019 | SIGMOD |
| 3 | 11,665 | Klink: Progress-Aware Scheduling for Streaming Data Systems | 2021 | SIGMOD |
| 4 | 9,670 | Optimistic Recovery for Iterative Dataflows in Action | 2015 | SIGMOD |
| 5 | 1,895 | Samza: Stateful Scalable Stream Processing at LinkedIn | 2017 | VLDB |
| 6 | 6,502 | Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow | 2021 | VLDB |
| 7 | 11,086 | How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems | 2025 | VLDB |
| 8 | 4,389 | Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka | 2021 | SIGMOD |
| 9 | 983 | Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management | 2013 | SIGMOD |
| 10 | 9,468 | Disaggregated State Management in Apache Flink 2.0 | 2025 | VLDB |