Database Paper Browser

Back to papers

Spinning Fast Iterative Data Flows

Summary: Integrates incremental (workset) iterations into parallel dataflows, enabling mutable state and exploitation of sparse dependencies in iterative algorithms. Prototype shows up to 100× speedups and competitive results versus specialized systems, while preserving a unified dataflow abstraction. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10364
Venue
VLDB
Year
2012
Pagerank
9.3706587e-05
Overall Rank
2,172 | 84.90%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank Citing Paper Year Venue Pagerank
522 Differential dataflow 2013 CIDR 0.00021099241
1,532 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011472681
2,350 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.9788641e-05
2,487 Large-Scale Graph Analytics in Aster 6: Bringing Context to Big Data Discovery 2014 VLDB 8.6710828e-05
2,529 Pregelix: Big(ger) Graph Analytics on A Dataflow Engine 2015 VLDB 8.5940768e-05
2,818 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0665558e-05
3,200 Big Data Analytics with Datalog Queries on Spark 2016 SIGMOD 7.3912411e-05
4,696 Asynchronous and Fault-Tolerant Recursive Datalog Evaluation in Shared-Nothing Engines 2015 VLDB 5.9911301e-05
5,433 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.5051607e-05
5,688 PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics 2013 VLDB 5.3702808e-05
7,903 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 4.6215911e-05
8,051 Building Advanced SQL Analytics From Low-Level Plan Operators 2021 SIGMOD 4.5969549e-05
9,547 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 4.3259935e-05
9,666 Breaking the Chains: On Declarative Data Analysis and Data Independence in the Big Data Era 2014 VLDB 4.3082114e-05
11,472 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.1945683e-05
12,039 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0040449103
4 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0019005923
20 GAMMA - A High Performance Dataflow Database Machine 1986 VLDB 0.00086459551
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.0008456613
77 An Amateur's Introduction to Recursive Query Processing Strategies 1986 SIGMOD 0.00057043861
232 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.00032122485
365 On the Power of Magic 1987 PODS 0.00025585898
413 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00023904409
520 An Overview of The System Software of A Parallel Relational Database Machine GRACE 1986 VLDB 0.00021152636
2,611 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.4536967e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
538 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020678804
8,534 Translation of Array-Based Loops to Distributed Data-Parallel Programs 2020 VLDB 4.4937074e-05
9,547 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 4.3259935e-05
9,504 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 4.3341665e-05
3,710 Optimizing Analytic Data Flows for Multiple Execution Engines 2012 SIGMOD 6.8238962e-05
8,078 Meta-Dataflows: Efficient Exploratory Dataflow Jobs 2018 SIGMOD 4.5914967e-05
1,685 Fast Iterative Graph Computation with Block Updates 2013 VLDB 0.0001091808
522 Differential dataflow 2013 CIDR 0.00021099241
12,039 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD 4.1945683e-05
5,209 Explaining Outputs in Modern Data Analytics 2016 VLDB 5.629362e-05