DBScholar

Back to papers

Differential dataflow

Summary: Differential computation: extends incremental computation with arbitrarily nested iteration to maintain iterative queries over continuously changing inputs. Implemented in the Naiad data-parallel dataflow, enabling efficient interactive incremental algorithms (e.g., SCC) on streaming graphs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
hf533715007be1413
Venue
CIDR
Year
2013
Pagerank
0.00018201988
Overall Rank
442 | 97.04%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{mcsherry_cidr13,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '13},
        title = {{Differential dataflow}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {McSherry, Frank and Murray, Derek G. and Isaacs, Rebecca and Isard, Michael},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 49 of 49 citing papers.

Rank Citing Paper Year Venue Pagerank
497 From "Think Like a Vertex" to "Think Like a Graph" 2014 VLDB 0.00017315387
1,123 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD 0.00011926683
1,504 Asynchronous Large-Scale Graph Processing Made Easy 2013 CIDR 0.00010450172
1,964 Fast Iterative Graph Computation with Block Updates 2013 VLDB 9.302712e-05
2,087 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.0661817e-05
2,740 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0682988e-05
2,939 RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark 2019 SIGMOD 7.8318902e-05
3,115 RisGraph: A Real-Time Streaming System for Evolving Graphs to Support Sub-millisecond Per-update Analysis at Millions Ops/s 2021 SIGMOD 7.6315625e-05
3,675 DBSP: Automatic Incremental View Maintenance for Rich Query Languages 2023 VLDB 7.1058941e-05
4,039 HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning 2021 SIGMOD 6.835801e-05
4,402 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB 6.6120647e-05
4,541 Incrementalizing Graph Algorithms 2021 SIGMOD 6.547718e-05
4,781 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.4154314e-05
4,937 Explaining Outputs in Modern Data Analytics 2016 VLDB 6.3443901e-05
5,516 Big Graphs: Challenges and Opportunities 2022 VLDB 6.0957673e-05
5,684 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD 6.0362827e-05
5,772 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.9964298e-05
6,325 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.8121503e-05
6,626 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.7288333e-05
6,640 Physical Visualization Design: Decoupling Interface and System Design 2025 SIGMOD 5.72354e-05
7,270 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.5671818e-05
7,288 Experimental Analysis of Distributed Graph Systems 2018 VLDB 5.5632324e-05
8,220 Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques 2023 VLDB 5.3745507e-05
8,433 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.3324907e-05
8,567 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.3118554e-05
8,595 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 5.305302e-05
8,991 Graphsurge: Graph Analytics on View Collections Using Differential Computation 2021 SIGMOD 5.2412183e-05
9,236 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 5.2032182e-05
9,471 BYO: A Unified Framework for Benchmarking Large-Scale Graph Containers 2024 VLDB 5.170541e-05
9,583 A Step Toward Deep Online Aggregation 2023 SIGMOD 5.154741e-05
9,716 Serenade - Low-Latency Session-Based Recommendation in e-Commerce at Scale 2022 SIGMOD 5.1347107e-05
9,718 CHEX: Multiversion Replay with Ordered Checkpoints 2022 VLDB 5.1345893e-05
9,745 TreeToaster: Towards an IVM-Optimized Compiler 2021 SIGMOD 5.1325223e-05
9,923 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.1079647e-05
10,153 Datalog with First-Class Facts 2025 VLDB 5.0691578e-05
10,161 Automating Incremental Graph Processing with Flexible Memoization 2021 VLDB 5.0682049e-05
10,202 Ariadne: Online Provenance for Big Graph Analytics 2019 SIGMOD 5.0599411e-05
10,274 Keep Your Distributed Data Warehouse Consistent at a Minimal Cost 2023 SIGMOD 5.0467517e-05
10,337 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB 5.0288349e-05
10,514 SmartRabbit: An Interactive Query Processor 2026 SIGMOD 4.9769913e-05
10,893 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB 4.9769913e-05
10,894 Storing and Indexing Multiple Tables by Interesting Orderings: For Efficient Joins, Groupings, and Updates in Relational Databases 2026 VLDB 4.9769913e-05
10,931 Virtualizing Recursion: Just-In-Time Graph Analytics in a Hyperscale Relational Warehouse 2026 VLDB 4.9769913e-05
11,045 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9769913e-05
11,413 mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines” 2025 VLDB 4.9769913e-05
11,627 Snapcase – Regain Control over Your Predictions with Low-Latency Machine Unlearning 2024 VLDB 4.9769913e-05
11,727 When Automatic Filtering Comes to the Rescue: Pre-Computing Company Competitor Pairs in Owler 2023 SIGMOD 4.9769913e-05
11,982 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.9769913e-05
12,561 Functions Are Data Too (Defunctionalization for PL/SQL) 2013 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012087459
39 Efficiently Updating Materialized Views 1986 SIGMOD 0.00046583225
62 Maintaining Views Incrementally 1993 SIGMOD 0.00039040346
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019471648
408 DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views 2012 VLDB 0.00018894165
2,228 Spinning Fast Iterative Data Flows 2012 VLDB 8.7996087e-05
2,481 REX: Recursive, Delta-Based Data-Centric Computation 2012 VLDB 8.3995962e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,402 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB
2 12,534 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD
3 2,753 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
4 10,893 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB
5 325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB
6 5,684 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD
7 1,964 Fast Iterative Graph Computation with Block Updates 2013 VLDB
8 10,337 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB
9 4,937 Explaining Outputs in Modern Data Analytics 2016 VLDB
10 2,228 Spinning Fast Iterative Data Flows 2012 VLDB