DBScholar

Back to papers

MillWheel: Fault-Tolerant Stream Processing at Internet Scale

Summary: MillWheel is a Google-scale, low-latency stream-processing framework where users define computation graphs while the system manages persistent state, record flow, and fault tolerance. Its distinctive logical-time programming model simplifies time-based aggregation alongside scalable, resilient execution. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h17732676c490721e
Venue
VLDB
Year
2013
Pagerank
0.00024390324
Overall Rank
218 | 98.54%
DOI
10.14778/2536222.2536229

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{akidau_vldb13,
        title = {{MillWheel: Fault-Tolerant Stream Processing at Internet Scale}},
        author = {Akidau, Tyler and Balikov, Alex and Bekiroğlu, Kaya and Chernyak, Slava and Haberman, Josh and Lax, Reuven and McVeety, Sam and Mills, Daniel and Nordstrom, Paul and Whittle, Sam},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {11},
        pages = {1033--1044},
        doi = {10.14778/2536222.2536229},
        url = {https://doi.org/10.14778/2536222.2536229},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 20 of 70 citing papers.

Rank Citing Paper Year Venue Pagerank
9,648 Disaggregated State Management in Apache Flink 2.0 2025 VLDB 5.1453267e-05
9,810 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 5.1257999e-05
9,816 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 5.1257999e-05
9,916 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.1103839e-05
10,862 Fugue: Online Elasticity for Distributed Stateful Stream Processing 2026 VLDB 4.9793485e-05
10,925 The Live Database: Firestore’s Scalable and Consistent Realtime Queries 2026 VLDB 4.9793485e-05
10,927 A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs 2026 VLDB 4.9793485e-05
11,036 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9793485e-05
11,129 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 4.9793485e-05
11,145 CORE+: A Complex Event Recognition Engine in C++ 2025 SIGMOD 4.9793485e-05
11,372 Scribe: How Meta transports terabytes per second in real time 2025 VLDB 4.9793485e-05
11,772 Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and Insertions 2023 VLDB 4.9793485e-05
11,815 Making Cache Monotonic and Consistent 2023 VLDB 4.9793485e-05
11,940 Synchronization Schemas 2021 PODS 4.9793485e-05
11,972 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.9793485e-05
12,168 Online Template Induction for Machine-Generated Emails 2019 VLDB 4.9793485e-05
12,213 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.9793485e-05
12,232 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.9793485e-05
12,317 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB 4.9793485e-05
12,345 The Challenges of Global-scale Data Management 2016 SIGMOD 4.9793485e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
26 Models and Issues in Data Stream Systems 2002 PODS 0.00052121228
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030427614
152 Query Processing, Resource Management, and Approximation in a Data Stream Management System 2003 CIDR 0.0002867034
231 Storm @Twitter 2014 SIGMOD 0.00023841089
429 Flexible Time Management in Data Stream Systems 2004 PODS 0.00018439857
510 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00017065714
1,197 Out-of-Order Processing: A New Architecture for High-Performance Stream Systems 2008 VLDB 0.00011566535
1,724 Gigascope: High Performance Network Monitoring with an SQL Interface 2002 SIGMOD 9.791892e-05
3,324 A Heartbeat Mechanism and its Application in Gigascope 2005 VLDB 7.4285048e-05
3,790 Fault-tolerant Stream Processing using a Distributed, Replicated File System 2008 VLDB 7.0190297e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB
2 3,790 Fault-tolerant Stream Processing using a Distributed, Replicated File System 2008 VLDB
3 13,836 Fault-Tolerance for Distributed Iterative Dataflows in Action 2018 VLDB
4 968 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
5 1,828 Fault-Tolerance in the Borealis Distributed Stream Processing System 2005 SIGMOD
6 1,228 Highly Available, Fault-Tolerant, Parallel Dataflows 2004 SIGMOD
7 9,773 Cost-based Fault-tolerance for Parallel Data Processing 2015 SIGMOD
8 10,158 Railgun: managing large streaming windows under MAD requirements 2021 VLDB
9 1,175 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD
10 12,317 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB