DBScholar

Back to papers

MillWheel: Fault-Tolerant Stream Processing at Internet Scale

Summary: MillWheel is a Google-scale, low-latency stream-processing framework where users define computation graphs while the system manages persistent state, record flow, and fault tolerance. Its distinctive logical-time programming model simplifies time-based aggregation alongside scalable, resilient execution. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h17732676c490721e
Venue
VLDB
Year
2013
Pagerank
0.0002429959
Overall Rank
219 | 98.54%
DOI
10.14778/2536222.2536229

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{akidau_vldb13,
        title = {{MillWheel: Fault-Tolerant Stream Processing at Internet Scale}},
        author = {Akidau, Tyler and Balikov, Alex and Bekiroğlu, Kaya and Chernyak, Slava and Haberman, Josh and Lax, Reuven and McVeety, Sam and Mills, Daniel and Nordstrom, Paul and Whittle, Sam},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {11},
        pages = {1033--1044},
        doi = {10.14778/2536222.2536229},
        url = {https://doi.org/10.14778/2536222.2536229},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 70 citing papers.

Rank Citing Paper Year Venue Pagerank
233 Storm @Twitter 2014 SIGMOD 0.00023754096
328 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020889528
607 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.00015577054
688 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014736145
1,244 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00011363001
1,310 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011065568
1,409 State Management in Apache Flink: Consistent Stateful Distributed Stream Processing 2017 VLDB 0.00010732706
1,640 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 9.9825117e-05
1,785 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.6438157e-05
1,951 S-Store: Streaming Meets Transaction Processing 2015 VLDB 9.302451e-05
2,730 Partial Results in Database Systems 2014 SIGMOD 8.0676725e-05
2,751 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0416632e-05
2,871 SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics 2017 CIDR 7.9024682e-05
3,043 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7045781e-05
3,117 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 7.6142606e-05
3,138 How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates 2016 SIGMOD 7.5866991e-05
3,379 Frontier: Resilient Edge Processing for the Internet of Things 2018 VLDB 7.3417159e-05
3,395 Timon: A Timestamped Event Database for Efficient Telemetry Data Processing and Analytics 2020 SIGMOD 7.3281547e-05
3,409 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 7.3076317e-05
3,873 Husky: Towards a More Efficient and Expressive Distributed Computing Framework 2016 VLDB 6.9389809e-05
3,939 Analyzing Efficient Stream Processing on Modern Hardware 2019 VLDB 6.8967981e-05
4,129 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.7751787e-05
4,327 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 6.6480683e-05
4,475 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.5699934e-05
4,800 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.3942642e-05
4,889 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.3513193e-05
4,908 One SQL to Rule Them All – an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables 2019 SIGMOD 6.3470129e-05
4,942 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 6.3309707e-05
5,861 Optimal and General Out-of-Order Sliding-Window Aggregation 2019 VLDB 5.9505926e-05
5,952 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB 5.9182633e-05
6,189 Helios: Hyperscale Indexing for the Cloud & Edge 2020 VLDB 5.8391363e-05
6,240 Providing Streaming Joins as a Service at Facebook 2018 VLDB 5.8234435e-05
6,257 Pixida: Optimizing Data Parallel Jobs in Wide-Area Data Analytics 2016 VLDB 5.8160712e-05
6,281 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.8083033e-05
6,456 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 5.7616575e-05
6,635 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.7098902e-05
6,809 Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile 2021 VLDB 5.660585e-05
7,032 Incremental Sliding Window Connectivity over Streaming Graphs 2024 VLDB 5.5999021e-05
7,289 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.5487732e-05
7,333 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB 5.5344269e-05
7,340 Ananke: A Streaming Framework for Live Forward Provenance 2021 VLDB 5.5333914e-05
7,720 Enabling Efficient and General Subpopulation Analytics in Multidimensional Data Streams 2022 VLDB 5.4542911e-05
7,857 Quill: Efficient, Transferable, and Rich Analytics at Scale 2016 VLDB 5.4230146e-05
7,996 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 5.3941543e-05
8,585 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.2943199e-05
8,930 InvaliDB: Scalable Push-Based Real-Time Queries on Top of Pull-Based Databases (Extended) 2020 VLDB 5.2361195e-05
9,108 Texera: A System for Collaborative and Interactive Data Analytics Using Workflows 2024 VLDB 5.208561e-05
9,260 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 5.1860131e-05
9,511 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 5.1516241e-05
9,668 Shrink - Prescribing Resiliency Solutions for Streaming 2017 VLDB 5.1276742e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers