DBScholar

Back to papers

Disaggregated State Management in Apache Flink 2.0

Summary: Flink 2.0 disaggregates state from compute, streaming updates to a remote DFS while caching locally and masking latency asynchronously. ForSt’s unified filesystem enables lightweight checkpointing, recovery, and reconfiguration—up to 94% shorter checkpoints, 49× faster recovery, and 50% lower cost. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h76502f33a8ba24a4
Venue
VLDB
Year
2025
Pagerank
5.142891e-05
Overall Rank
9,656 | 35.11%
DOI
10.14778/3750601.3750609
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{mei_vldb25,
        title = {{Disaggregated State Management in Apache Flink 2.0}},
        author = {Mei, Yuan and Xia, Rui and Lan, Zhaoqian and Hu, Kaitian and Huang, Lei and Carbone, Paris and Lei, Yanfei and Kalavri, Vasiliki and Yin, Han and Wang, Feng},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {12},
        pages = {4848--4859},
        doi = {10.14778/3750601.3750609},
        url = {https://doi.org/10.14778/3750601.3750609},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank Citing Paper Year Venue Pagerank
11,072 Terark-DS: A High-Performance and Storage-Efficient Key-Value Separation Storage Engine on Disaggregated Storage 2026 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041210636
63 Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases 2017 SIGMOD 0.00038521221
218 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024379041
231 Storm @Twitter 2014 SIGMOD 0.00023830094
240 Gigascope: A Stream Database for Network Applications 2003 SIGMOD 0.00023425462
325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.0002095522
369 Continuous Queries over Append-Only Databases 1992 SIGMOD 0.0001984577
430 Flexible Time Management in Data Stream Systems 2004 PODS 0.00018431194
511 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00017058115
681 Amazon Redshift Re-invented 2022 SIGMOD 0.0001482366
1,198 Out-of-Order Processing: A New Architecture for High-Performance Stream Systems 2008 VLDB 0.00011561138
1,218 PolarFS: An Ultra-low Latency and Failure Resilient Distributed File System for Shared Storage Cloud Database 2018 VLDB 0.00011484231
1,303 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011101274
1,402 State Management in Apache Flink: Consistent Stateful Distributed Stream Processing 2017 VLDB 0.00010766851
1,512 Cloud-Native Database Systems at Alibaba: Opportunities and Challenges 2019 VLDB 0.00010425349
1,633 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010015001
1,771 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.6757926e-05
1,790 POLARIS: The Distributed SQL Engine in Azure Synapse 2020 VLDB 9.6227952e-05
1,829 Fault-Tolerance in the Borealis Distributed Stream Processing System 2005 SIGMOD 9.5470848e-05
1,939 S-Store: Streaming Meets Transaction Processing 2015 VLDB 9.3299482e-05
2,483 AnalyticDB: Real-time OLAP Database System at Alibaba Cloud 2019 VLDB 8.3973995e-05
2,671 Taurus Database: How to be Fast, Available, and Frugal in the Cloud 2020 SIGMOD 8.1464332e-05
3,576 STREAM: The Stanford Stream Data Manager (Demonstration Description) 2003 SIGMOD 7.1922202e-05
3,675 DBSP: Automatic Incremental View Maintenance for Rich Query Languages 2023 VLDB 7.1058941e-05
4,310 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 6.6700421e-05
4,453 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.59179e-05
6,270 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.8275729e-05
6,626 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.7288333e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,601 AStream: Ad-hoc Shared Stream Processing 2019 SIGMOD
2 13,841 Fault-Tolerance for Distributed Iterative Dataflows in Action 2018 VLDB
3 11,978 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD
4 9,831 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD
5 1,123 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD
6 6,626 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB
7 10,936 A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs 2026 VLDB
8 970 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
9 10,871 Fugue: Online Elasticity for Distributed Stateful Stream Processing 2026 VLDB
10 1,402 State Management in Apache Flink: Consistent Stateful Distributed Stream Processing 2017 VLDB