DBScholar

Back to papers

Differential dataflow

Summary: Differential computation: extends incremental computation with arbitrarily nested iteration to maintain iterative queries over continuously changing inputs. Implemented in the Naiad data-parallel dataflow, enabling efficient interactive incremental algorithms (e.g., SCC) on streaming graphs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
hf533715007be1413
Venue
CIDR
Year
2013
Pagerank
0.0001815754
Overall Rank
444 | 97.03%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{mcsherry_cidr13,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '13},
        title = {{Differential dataflow}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {McSherry, Frank and Murray, Derek G. and Isaacs, Rebecca and Isard, Michael},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 49 of 49 citing papers.

Rank Citing Paper Year Venue Pagerank
486 From "Think Like a Vertex" to "Think Like a Graph" 2014 VLDB 0.00017462718
1,128 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD 0.00011887295
1,498 Asynchronous Large-Scale Graph Processing Made Easy 2013 CIDR 0.00010445866
1,960 Fast Iterative Graph Computation with Block Updates 2013 VLDB 9.2883583e-05
2,083 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.0563677e-05
2,751 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0416632e-05
2,953 RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark 2019 SIGMOD 7.8060043e-05
3,123 RisGraph: A Real-Time Streaming System for Evolving Graphs to Support Sub-millisecond Per-update Analysis at Millions Ops/s 2021 SIGMOD 7.6082482e-05
3,684 DBSP: Automatic Incremental View Maintenance for Rich Query Languages 2023 VLDB 7.0834345e-05
4,059 HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning 2021 SIGMOD 6.8133669e-05
4,422 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB 6.5902096e-05
4,557 Incrementalizing Graph Algorithms 2021 SIGMOD 6.5264915e-05
4,800 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.3942642e-05
4,963 Explaining Outputs in Modern Data Analytics 2016 VLDB 6.3234324e-05
5,496 Big Graphs: Challenges and Opportunities 2022 VLDB 6.0944008e-05
5,690 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD 6.0182427e-05
5,787 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.9768075e-05
6,336 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.7929324e-05
6,635 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.7098902e-05
6,650 Physical Visualization Design: Decoupling Interface and System Design 2025 SIGMOD 5.7046144e-05
7,285 Experimental Analysis of Distributed Graph Systems 2018 VLDB 5.5495566e-05
7,289 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.5487732e-05
8,231 Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques 2023 VLDB 5.3573407e-05
8,449 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.3148581e-05
8,585 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.2943199e-05
8,615 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 5.2878561e-05
9,010 Graphsurge: Graph Analytics on View Collections Using Differential Computation 2021 SIGMOD 5.2238876e-05
9,260 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 5.1860131e-05
9,501 BYO: A Unified Framework for Benchmarking Large-Scale Graph Containers 2024 VLDB 5.1534439e-05
9,608 A Step Toward Deep Online Aggregation 2023 SIGMOD 5.1376962e-05
9,732 Serenade - Low-Latency Session-Based Recommendation in e-Commerce at Scale 2022 SIGMOD 5.1200585e-05
9,749 CHEX: Multiversion Replay with Ordered Checkpoints 2022 VLDB 5.1176111e-05
9,777 TreeToaster: Towards an IVM-Optimized Compiler 2021 SIGMOD 5.115551e-05
9,958 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.0910746e-05
10,188 Datalog with First-Class Facts 2025 VLDB 5.052396e-05
10,196 Automating Incremental Graph Processing with Flexible Memoization 2021 VLDB 5.0514463e-05
10,235 Ariadne: Online Provenance for Big Graph Analytics 2019 SIGMOD 5.0432098e-05
10,301 Keep Your Distributed Data Warehouse Consistent at a Minimal Cost 2023 SIGMOD 5.030064e-05
10,363 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB 5.0122065e-05
10,580 SmartRabbit: An Interactive Query Processor 2026 SIGMOD 4.9605343e-05
10,954 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB 4.9605343e-05
10,955 Storing and Indexing Multiple Tables by Interesting Orderings: For Efficient Joins, Groupings, and Updates in Relational Databases 2026 VLDB 4.9605343e-05
10,992 Virtualizing Recursion: Just-In-Time Graph Analytics in a Hyperscale Relational Warehouse 2026 VLDB 4.9605343e-05
11,106 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9605343e-05
11,466 mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines” 2025 VLDB 4.9605343e-05
11,674 Snapcase – Regain Control over Your Predictions with Low-Latency Machine Unlearning 2024 VLDB 4.9605343e-05
11,773 When Automatic Filtering Comes to the Rescue: Pre-Computing Company Competitor Pairs in Owler 2023 SIGMOD 4.9605343e-05
12,026 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.9605343e-05
12,604 Functions Are Data Too (Defunctionalization for PL/SQL) 2013 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012089097
39 Efficiently Updating Materialized Views 1986 SIGMOD 0.00046445099
62 Maintaining Views Incrementally 1993 SIGMOD 0.00038944207
385 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019419661
408 DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views 2012 VLDB 0.00018836656
2,240 Spinning Fast Iterative Data Flows 2012 VLDB 8.7716808e-05
2,491 REX: Recursive, Delta-Based Data-Centric Computation 2012 VLDB 8.3733589e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,422 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB
2 12,577 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD
3 2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
4 10,954 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB
5 328 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB
6 5,690 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD
7 1,960 Fast Iterative Graph Computation with Block Updates 2013 VLDB
8 10,363 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB
9 4,963 Explaining Outputs in Modern Data Analytics 2016 VLDB
10 2,240 Spinning Fast Iterative Data Flows 2012 VLDB