Database Paper Browser

Back to papers

Spinning Fast Iterative Data Flows

Summary: Integrates incremental (workset) iterations into parallel dataflows, enabling mutable state and exploitation of sparse dependencies in iterative algorithms. Prototype shows up to 100× speedups and competitive results versus specialized systems, while preserving a unified dataflow abstraction. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10365
Venue
VLDB
Year
2012
Pagerank
9.3632007e-05
Overall Rank
2,179 | 84.86%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank Citing Paper Year Venue Pagerank
524 Differential dataflow 2013 CIDR 0.00021093133
1,534 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011462072
2,355 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.9727612e-05
2,486 Large-Scale Graph Analytics in Aster 6: Bringing Context to Big Data Discovery 2014 VLDB 8.6644935e-05
2,528 Pregelix: Big(ger) Graph Analytics on A Dataflow Engine 2015 VLDB 8.5953347e-05
2,823 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0593793e-05
3,207 Big Data Analytics with Datalog Queries on Spark 2016 SIGMOD 7.3847098e-05
4,694 Asynchronous and Fault-Tolerant Recursive Datalog Evaluation in Shared-Nothing Engines 2015 VLDB 5.985448e-05
5,444 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.4998709e-05
5,699 PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics 2013 VLDB 5.3655096e-05
7,900 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 4.6176856e-05
8,053 Building Advanced SQL Analytics From Low-Level Plan Operators 2021 SIGMOD 4.5925468e-05
9,548 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 4.3219254e-05
9,666 Breaking the Chains: On Declarative Data Analysis and Data Independence in the Big Data Era 2014 VLDB 4.3040577e-05
11,475 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.1905499e-05
12,047 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0040465394
4 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0019040811
21 GAMMA - A High Performance Dataflow Database Machine 1986 VLDB 0.00086104592
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00084679526
79 An Amateur's Introduction to Recursive Query Processing Strategies 1986 SIGMOD 0.00056010993
230 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.00032145125
359 On the Power of Magic 1987 PODS 0.00025830228
408 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00023939456
518 An Overview of The System Software of A Parallel Relational Database Machine GRACE 1986 VLDB 0.00021161322
2,616 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.4457819e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
536 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020651621
8,533 Translation of Array-Based Loops to Distributed Data-Parallel Programs 2020 VLDB 4.4893996e-05
9,548 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 4.3219254e-05
9,505 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 4.3300131e-05
3,714 Optimizing Analytic Data Flows for Multiple Execution Engines 2012 SIGMOD 6.8176849e-05
8,081 Meta-Dataflows: Efficient Exploratory Dataflow Jobs 2018 SIGMOD 4.5871672e-05
524 Differential dataflow 2013 CIDR 0.00021093133
1,684 Fast Iterative Graph Computation with Block Updates 2013 VLDB 0.00010912102
12,047 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD 4.1905499e-05
5,212 Explaining Outputs in Modern Data Analytics 2016 VLDB 5.6239563e-05