Database Paper Browser

Back to papers

MillWheel: Fault-Tolerant Stream Processing at Internet Scale

Summary: MillWheel offers fault-tolerant, low-latency stream processing at Internet scale via a directed computation graph, persistent state, and continuous dataflow. Logical time-based aggregations, scalable fault tolerance, and a Google case study (anomaly detector) illustrate its unique programming model and broad applicability to data-intensive, real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10542
Venue
VLDB
Year
2013
Pagerank
0.00024389768
Overall Rank
222 | 98.46%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 66 citing papers.

Rank Citing Paper Year Venue Pagerank
214 Storm @Twitter 2014 SIGMOD 0.00024818518
358 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.0002031664
596 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.00016038481
699 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014997628
1,177 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00011908392
1,387 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011038963
1,607 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010307026
1,784 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.8443759e-05
1,822 S-Store: Streaming Meets Transaction Processing 2015 VLDB 9.771749e-05
2,602 Partial Results in Database Systems 2014 SIGMOD 8.4256834e-05
2,803 General Incremental Sliding-Window Aggregation 2015 VLDB 8.1681516e-05
2,868 SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics 2017 CIDR 8.0819785e-05
2,961 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.9686889e-05
3,000 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 7.9260014e-05
3,039 How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates 2016 SIGMOD 7.8829044e-05
3,194 Frontier: Resilient Edge Processing for the Internet of Things 2018 VLDB 7.721863e-05
3,277 Timon: A Timestamped Event Database for Efficient Telemetry Data Processing and Analytics 2020 SIGMOD 7.6339617e-05
3,369 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 7.5425234e-05
3,731 Husky: Towards a More Efficient and Expressive Distributed Computing Framework 2016 VLDB 7.225505e-05
3,778 Analyzing Efficient Stream Processing on Modern Hardware 2019 VLDB 7.1851487e-05
4,114 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.9553427e-05
4,318 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.8363529e-05
4,646 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.6520921e-05
4,714 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 6.6134591e-05
4,749 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 6.5984973e-05
4,856 One SQL to Rule Them All – an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables 2019 SIGMOD 6.5414245e-05
5,552 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.2374614e-05
5,708 Optimal and General Out-of-Order Sliding-Window Aggregation 2019 VLDB 6.1797581e-05
5,729 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB 6.170083e-05
5,930 Providing Streaming Joins as a Service at Facebook 2018 VLDB 6.1000158e-05
5,958 Helios: Hyperscale Indexing for the Cloud & Edge 2020 VLDB 6.0886149e-05
6,034 Pixida: Optimizing Data Parallel Jobs in Wide-Area Data Analytics 2016 VLDB 6.0603162e-05
6,255 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 6.0003158e-05
6,357 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.9654209e-05
6,505 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.9144751e-05
7,076 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB 5.7629614e-05
7,161 Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile 2021 VLDB 5.7442397e-05
7,416 Enabling Efficient and General Subpopulation Analytics in Multidimensional Data Streams 2022 VLDB 5.6873825e-05
7,450 Ananke: A Streaming Framework for Live Forward Provenance 2021 VLDB 5.6770418e-05
7,544 Incremental Sliding Window Connectivity over Streaming Graphs 2024 VLDB 5.6560227e-05
7,583 Quill: Efficient, Transferable, and Rich Analytics at Scale 2016 VLDB 5.6487011e-05
7,687 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 5.6249337e-05
8,488 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.4871358e-05
8,784 Texera: A System for Collaborative and Interactive Data Analytics Using Workflows 2024 VLDB 5.4311509e-05
8,936 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.4076395e-05
9,200 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 5.3688031e-05
9,323 Shrink – Prescribing Resiliency Solutions for Streaming 2017 VLDB 5.3457875e-05
9,328 Disaggregated State Management in Apache Flink® 2.0 2025 VLDB 5.3449422e-05
9,491 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 5.3246578e-05
9,499 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 5.3246578e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers