DBScholar

Back to papers

The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing

Summary: Introduces the Dataflow Model for massive-scale, unbounded, out-of-order streams, treating results as perpetually evolving rather than eventually complete. Exposes principled tradeoffs among event-time correctness, latency, and cost via watermarks, triggers, and retractions. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h3eb25e9eb82dd88c
Venue
VLDB
Year
2015
Pagerank
0.00020889528
Overall Rank
328 | 97.81%
DOI
10.14778/2824032.2824076
PDF
Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{akidau_vldb15,
        title = {{The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing}},
        author = {Akidau, Tyler and Bradshaw, Robert and Chambers, Craig and Chernyak, Slava and Fernández-Moctezuma, Rafael J. and Lax, Reuven and McVeety, Sam and Mills, Daniel and Perry, Frances and Schmidt, Eric and Whittle, Sam},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {12},
        pages = {1792--1803},
        doi = {10.14778/2824032.2824076},
        url = {https://doi.org/10.14778/2824032.2824076},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 72 citing papers.

Rank Citing Paper Year Venue Pagerank
10,838 IncreQueryFusion: On-demand Data Fusion Framework in Dynamic Data Lakes 2026 VLDB 4.9605343e-05
10,932 Fugue: Online Elasticity for Distributed Stateful Stream Processing 2026 VLDB 4.9605343e-05
10,992 Virtualizing Recursion: Just-In-Time Graph Analytics in a Hyperscale Relational Warehouse 2026 VLDB 4.9605343e-05
10,997 A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs 2026 VLDB 4.9605343e-05
11,067 Demonstration of BobFlow: Human-Agent Collaboration Using Dataflows on Data Science Tasks 2026 VLDB 4.9605343e-05
11,106 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9605343e-05
11,197 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 4.9605343e-05
11,340 Unraveling the Impact of Window Semantics: Optimizing Join Order for Efficient Stream Processing 2025 VLDB 4.9605343e-05
11,431 Scribe: How Meta transports terabytes per second in real time 2025 VLDB 4.9605343e-05
11,494 Analyzing Near-Network Hardware Acceleration with Co-Processing on DPUs 2025 VLDB 4.9605343e-05
11,497 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB 4.9605343e-05
11,563 PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation 2024 SIGMOD 4.9605343e-05
11,722 Raising the Level of Abstraction for Time-State Analytics With the Timeline Framework 2023 CIDR 4.9605343e-05
11,805 Fries: Fast and Consistent Runtime Reconfiguration in Dataflow Systems with Transactional Guarantees 2023 VLDB 4.9605343e-05
11,850 Portals: A Showcase of Multi-Dataflow Stateful Serverless 2023 VLDB 4.9605343e-05
11,990 Synchronization Schemas 2021 PODS 4.9605343e-05
12,022 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.9605343e-05
12,040 Real-time Data Infrastructure at Uber 2021 SIGMOD 4.9605343e-05
12,055 In the Land of Data Streams where Synopses are Missing, One Framework to Bring Them All 2021 VLDB 4.9605343e-05
12,262 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.9605343e-05
12,281 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.9605343e-05
12,353 CarStream: An Industrial System of Big Data Processing for Internet-of-Vehicles 2017 VLDB 4.9605343e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers