DBScholar

Back to papers

The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing

Summary: Introduces the Dataflow Model for massive-scale, unbounded, out-of-order streams, treating results as perpetually evolving rather than eventually complete. Exposes principled tradeoffs among event-time correctness, latency, and cost via watermarks, triggers, and retractions. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11245
Venue
VLDB
Year
2015
Pagerank
0.00020138717
Overall Rank
361 | 97.53%
DOI
10.14778/2824032.2824076

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{akidau_vldb15,
        title = {{The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing}},
        author = {Akidau, Tyler and Bradshaw, Robert and Chambers, Craig and Chernyak, Slava and Fernández-Moctezuma, Rafael J. and Lax, Reuven and McVeety, Sam and Mills, Daniel and Perry, Frances and Schmidt, Eric and Whittle, Sam},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {12},
        pages = {1792--1803},
        doi = {10.14778/2824032.2824076},
        url = {https://doi.org/10.14778/2824032.2824076},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 16 of 66 citing papers.

Rank Citing Paper Year Venue Pagerank
10,996 Scribe: How Meta transports terabytes per second in real time 2025 VLDB 5.093636e-05
10,999 cedar: Optimized and Unified Machine Learning Input Data Pipelines 2025 VLDB 5.093636e-05
11,080 Analyzing Near-Network Hardware Acceleration with Co-Processing on DPUs 2025 VLDB 5.093636e-05
11,086 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB 5.093636e-05
11,159 PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation 2024 SIGMOD 5.093636e-05
11,352 Raising the Level of Abstraction for Time-State Analytics With the Timeline Framework 2023 CIDR 5.093636e-05
11,443 Fries: Fast and Consistent Runtime Reconfiguration in Dataflow Systems with Transactional Guarantees 2023 VLDB 5.093636e-05
11,491 Portals: A Showcase of Multi-Dataflow Stateful Serverless 2023 VLDB 5.093636e-05
11,633 Synchronization Schemas 2021 PODS 5.093636e-05
11,665 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 5.093636e-05
11,683 Real-time Data Infrastructure at Uber 2021 SIGMOD 5.093636e-05
11,700 In the Land of Data Streams where Synopses are Missing, One Framework to Bring Them All 2021 VLDB 5.093636e-05
11,820 InvaliDB: Scalable Push-Based Real-Time Queries on Top of Pull-Based Databases (Extended) 2020 VLDB 5.093636e-05
11,914 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 5.093636e-05
11,933 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 5.093636e-05
12,008 CarStream: An Industrial System of Big Data Processing for Internet-of-Vehicles 2017 VLDB 5.093636e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
25 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00054667018
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
224 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024130894
424 Flexible Time Management in Data Stream Systems 2004 PODS 0.0001870735
505 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00017285498
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
710 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014715033
899 Consistent Streaming Through Time: A Vision for Event Stream Processing 2007 CIDR 0.00013337792
1,223 Out-of-Order Processing: A New Architecture for High-Performance Stream Systems 2008 VLDB 0.00011602265
1,639 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010155021
1,703 Semantics and Evaluation Techniques for Window Aggregates in Data Streams 2005 SIGMOD 9.9673138e-05
3,242 SECRET: A Model for Analysis of the Execution Semantics of Stream Processing Systems 2010 VLDB 7.6053312e-05
3,332 A Heartbeat Mechanism and its Application in Gigascope 2005 VLDB 7.5129799e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,945 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD
2 3,275 Optimizing Analytic Data Flows for Multiple Execution Engines 2012 SIGMOD
3 2,077 Generating Example Data for Dataflow Programs 2009 SIGMOD
4 9,640 Supporting Scalable Analytics with Latency Constraints 2015 VLDB
5 8,394 Topology-aware Parallel Data Processing: Models, Algorithms and Systems at Scale 2020 CIDR
6 4,117 Schedule Optimization for Data Processing Flows on the Cloud 2011 SIGMOD
7 3,913 An Approach to Optimize Data Processing in Business Processes 2007 VLDB
8 2,196 Spinning Fast Iterative Data Flows 2012 VLDB
9 26 Models and Issues in Data Stream Systems 2002 PODS
10 2,606 Process And Dataflow Control In Distributed Data-Intensive Systems 1988 SIGMOD