DBScholar

Back to papers

Differential dataflow

Summary: Differential computation: extends incremental computation with arbitrarily nested iteration to maintain iterative queries over continuously changing inputs. Implemented in the Naiad data-parallel dataflow, enabling efficient interactive incremental algorithms (e.g., SCC) on streaming graphs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
hf533715007be1413
Venue
CIDR
Year
2013
Pagerank
0.00018210463
Overall Rank
442 | 97.03%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{mcsherry_cidr13,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '13},
        title = {{Differential dataflow}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {McSherry, Frank and Murray, Derek G. and Isaacs, Rebecca and Isard, Michael},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 49 of 49 citing papers.

Rank Citing Paper Year Venue Pagerank
496 From "Think Like a Vertex" to "Think Like a Graph" 2014 VLDB 0.00017323054
1,123 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD 0.0001193233
1,504 Asynchronous Large-Scale Graph Processing Made Easy 2013 CIDR 0.00010455083
1,963 Fast Iterative Graph Computation with Block Updates 2013 VLDB 9.3063317e-05
2,087 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.068879e-05
2,739 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0721161e-05
2,938 RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark 2019 SIGMOD 7.8355984e-05
3,113 RisGraph: A Real-Time Streaming System for Evolving Graphs to Support Sub-millisecond Per-update Analysis at Millions Ops/s 2021 SIGMOD 7.6351769e-05
3,673 DBSP: Automatic Incremental View Maintenance for Rich Query Languages 2023 VLDB 7.1092596e-05
4,037 HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning 2021 SIGMOD 6.8390354e-05
4,400 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB 6.6151947e-05
4,540 Incrementalizing Graph Algorithms 2021 SIGMOD 6.5508191e-05
4,777 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.4184698e-05
4,940 Explaining Outputs in Modern Data Analytics 2016 VLDB 6.345789e-05
5,513 Big Graphs: Challenges and Opportunities 2022 VLDB 6.0986544e-05
5,684 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD 6.0391416e-05
5,771 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.9992698e-05
6,321 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.814903e-05
6,620 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.7315465e-05
6,636 Physical Visualization Design: Decoupling Interface and System Design 2025 SIGMOD 5.7262507e-05
7,267 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.5698185e-05
7,286 Experimental Analysis of Distributed Graph Systems 2018 VLDB 5.565865e-05
8,213 Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques 2023 VLDB 5.3770961e-05
8,424 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.3350162e-05
8,560 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.3142933e-05
8,588 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 5.3078077e-05
8,980 Graphsurge: Graph Analytics on View Collections Using Differential Computation 2021 SIGMOD 5.2437006e-05
9,226 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 5.2056825e-05
9,462 BYO: A Unified Framework for Benchmarking Large-Scale Graph Containers 2024 VLDB 5.1729898e-05
9,575 A Step Toward Deep Online Aggregation 2023 SIGMOD 5.1571823e-05
9,711 Serenade - Low-Latency Session-Based Recommendation in e-Commerce at Scale 2022 SIGMOD 5.1371426e-05
9,713 CHEX: Multiversion Replay with Ordered Checkpoints 2022 VLDB 5.1370211e-05
9,740 TreeToaster: Towards an IVM-Optimized Compiler 2021 SIGMOD 5.1349531e-05
9,916 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.1103839e-05
10,149 Datalog with First-Class Facts 2025 VLDB 5.0715586e-05
10,157 Automating Incremental Graph Processing with Flexible Memoization 2021 VLDB 5.0706053e-05
10,196 Ariadne: Online Provenance for Big Graph Analytics 2019 SIGMOD 5.0623376e-05
10,268 Keep Your Distributed Data Warehouse Consistent at a Minimal Cost 2023 SIGMOD 5.0491419e-05
10,330 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB 5.0312167e-05
10,503 SmartRabbit: An Interactive Query Processor 2026 SIGMOD 4.9793485e-05
10,884 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB 4.9793485e-05
10,885 Storing and Indexing Multiple Tables by Interesting Orderings: For Efficient Joins, Groupings, and Updates in Relational Databases 2026 VLDB 4.9793485e-05
10,922 Virtualizing Recursion: Just-In-Time Graph Analytics in a Hyperscale Relational Warehouse 2026 VLDB 4.9793485e-05
11,036 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9793485e-05
11,407 mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines” 2025 VLDB 4.9793485e-05
11,621 Snapcase – Regain Control over Your Predictions with Low-Latency Machine Unlearning 2024 VLDB 4.9793485e-05
11,721 When Automatic Filtering Comes to the Rescue: Pre-Computing Company Competitor Pairs in Owler 2023 SIGMOD 4.9793485e-05
11,976 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.9793485e-05
12,555 Functions Are Data Too (Defunctionalization for PL/SQL) 2013 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012092602
39 Efficiently Updating Materialized Views 1986 SIGMOD 0.00046602544
62 Maintaining Views Incrementally 1993 SIGMOD 0.00039045511
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001948031
408 DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views 2012 VLDB 0.00018900199
2,227 Spinning Fast Iterative Data Flows 2012 VLDB 8.8021772e-05
2,480 REX: Recursive, Delta-Based Data-Centric Computation 2012 VLDB 8.4035081e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,400 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB
2 12,528 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD
3 2,754 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
4 10,884 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB
5 325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB
6 5,684 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD
7 1,963 Fast Iterative Graph Computation with Block Updates 2013 VLDB
8 10,330 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB
9 4,940 Explaining Outputs in Modern Data Analytics 2016 VLDB
10 2,227 Spinning Fast Iterative Data Flows 2012 VLDB