Database Paper Browser

Back to papers

MillWheel: Fault-Tolerant Stream Processing at Internet Scale

Summary: MillWheel offers fault-tolerant, low-latency stream processing at Internet scale via a directed computation graph, persistent state, and continuous dataflow. Logical time-based aggregations, scalable fault tolerance, and a Google case study (anomaly detector) illustrate its unique programming model and broad applicability to data-intensive, real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10541
Venue
VLDB
Year
2013
Pagerank
0.00028084774
Overall Rank
314 | 97.82%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 16 of 66 citing papers.

Rank Citing Paper Year Venue Pagerank
9,604 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 4.3177432e-05
10,410 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 4.1945683e-05
10,417 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 4.1945683e-05
10,431 CORE+: A Complex Event Recognition Engine in C++ 2025 SIGMOD 4.1945683e-05
10,766 Scribe: How Meta transports terabytes per second in real time 2025 VLDB 4.1945683e-05
11,261 Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and Insertions 2023 VLDB 4.1945683e-05
11,307 Making Cache Monotonic and Consistent 2023 VLDB 4.1945683e-05
11,435 Synchronization Schemas 2021 PODS 4.1945683e-05
11,468 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.1945683e-05
11,625 InvaliDB: Scalable Push-Based Real-Time Queries on Top of Pull-Based Databases (Extended) 2020 VLDB 4.1945683e-05
11,673 Online Template Induction for Machine-Generated Emails 2019 VLDB 4.1945683e-05
11,709 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.1945683e-05
11,728 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.1945683e-05
11,804 State Management in Apache Flink 2017 VLDB 4.1945683e-05
11,819 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB 4.1945683e-05
11,849 The Challenges of Global-scale Data Management 2016 SIGMOD 4.1945683e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
43 Models and Issues in Data Stream Systems 2002 PODS 0.00072723062
191 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00035738595
194 Query Processing, Resource Management, and Approximation in a Data Stream Management System 2003 CIDR 0.00035426067
288 Storm @Twitter 2014 SIGMOD 0.00028939871
432 Flexible Time Management in Data Stream Systems 2004 PODS 0.00023368424
591 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00019569071
1,551 Out-of-Order Processing: A New Architecture for High-Performance Stream Systems 2008 VLDB 0.00011416058
1,655 Gigascope: High Performance Network Monitoring with an SQL Interface 2002 SIGMOD 0.00010997332
3,237 A Heartbeat Mechanism and its Application in Gigascope 2005 VLDB 7.3351551e-05
3,886 Fault-tolerant Stream Processing using a Distributed, Replicated File System 2008 VLDB 6.6661649e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
538 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020678804
3,886 Fault-tolerant Stream Processing using a Distributed, Replicated File System 2008 VLDB 6.6661649e-05
13,322 Fault-Tolerance for Distributed Iterative Dataflows in Action 2018 VLDB -
1,226 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00013180799
1,990 Fault-Tolerance in the Borealis Distributed Stream Processing System 2005 SIGMOD 9.8472819e-05
1,357 Highly Available, Fault-Tolerant, Parallel Dataflows 2004 SIGMOD 0.00012392275
9,448 Cost-based Fault-tolerance for Parallel Data Processing 2015 SIGMOD 4.3401906e-05
9,803 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 4.2807806e-05
1,286 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD 0.0001282373
11,819 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB 4.1945683e-05