DBScholar

Back to papers

Differential dataflow

Summary: Differential computation: extends incremental computation with arbitrarily nested iteration to maintain iterative queries over continuously changing inputs. Implemented in the Naiad data-parallel dataflow, enabling efficient interactive incremental algorithms (e.g., SCC) on streaming graphs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
183
Venue
CIDR
Year
2013
Pagerank
0.00018133241
Overall Rank
455 | 96.89%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{mcsherry_cidr13,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '13},
        title = {{Differential dataflow}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {McSherry, Frank and Murray, Derek G. and Isaacs, Rebecca and Isard, Michael},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 46 of 46 citing papers.

Rank Citing Paper Year Venue Pagerank
487 From "Think Like a Vertex" to "Think Like a Graph" 2014 VLDB 0.00017645653
1,190 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD 0.00011743246
1,474 Asynchronous Large-Scale Graph Processing Made Easy 2013 CIDR 0.0001066385
1,911 Fast Iterative Graph Computation with Block Updates 2013 VLDB 9.4965133e-05
2,059 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.2471145e-05
2,802 General Incremental Sliding-Window Aggregation 2015 VLDB 8.1093063e-05
2,935 RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark 2019 SIGMOD 7.9444531e-05
3,068 RisGraph: A Real-Time Streaming System for Evolving Graphs to Support Sub-millisecond Per-update Analysis at Millions Ops/s 2021 SIGMOD 7.7939351e-05
3,960 HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning 2021 SIGMOD 6.9878154e-05
4,443 Incrementalizing Graph Algorithms 2021 SIGMOD 6.7004839e-05
4,534 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB 6.6420049e-05
4,686 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD 6.5620646e-05
4,845 Explaining Outputs in Modern Data Analytics 2016 VLDB 6.4818607e-05
4,865 DBSP: Automatic Incremental View Maintenance for Rich Query Languages 2023 VLDB 6.4731692e-05
5,567 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD 6.1709411e-05
5,608 Big Graphs: Challenges and Opportunities 2022 VLDB 6.1514145e-05
6,188 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.9483532e-05
6,263 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.936052e-05
6,502 Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow 2021 VLDB 5.8604458e-05
7,447 Experimental Analysis of Distributed Graph Systems 2018 VLDB 5.6149936e-05
8,115 Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques 2023 VLDB 5.4842672e-05
8,258 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.4574671e-05
8,430 A Demonstration of Iterative Parallel Array Processing in Support of Telescope Image Analysis 2013 VLDB 5.4263087e-05
8,571 Efficient Incrementialization of Correlated Nested Aggregate Queries using Relative Partial Aggregate Indexes (RPAI) 2022 SIGMOD 5.4102496e-05
8,830 Graphsurge: Graph Analytics on View Collections Using Differential Computation 2021 SIGMOD 5.3611079e-05
9,050 Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables 2025 SIGMOD 5.3251649e-05
9,064 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.3251649e-05
9,392 A Step Toward Deep Online Aggregation 2023 SIGMOD 5.2755515e-05
9,527 Serenade - Low-Latency Session-Based Recommendation in e-Commerce at Scale 2022 SIGMOD 5.2550158e-05
9,528 CHEX: Multiversion Replay with Ordered Checkpoints 2022 VLDB 5.2549275e-05
9,565 TreeToaster: Towards an IVM-Optimized Compiler 2021 SIGMOD 5.2528121e-05
9,738 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.227679e-05
9,781 BYO: A Unified Framework for Benchmarking Large-Scale Graph Containers 2024 VLDB 5.2209769e-05
9,959 Datalog with First-Class Facts 2025 VLDB 5.1879626e-05
9,967 Automating Incremental Graph Processing with Flexible Memoization 2021 VLDB 5.1869874e-05
10,063 Keep Your Distributed Data Warehouse Consistent at a Minimal Cost 2023 SIGMOD 5.1650158e-05
10,103 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB 5.1466947e-05
10,291 SmartRabbit: An Interactive Query Processor 2026 SIGMOD 5.093636e-05
10,582 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB 5.093636e-05
10,773 Physical Visualization Design: Decoupling Interface and System Design 2025 SIGMOD 5.093636e-05
11,043 mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines” 2025 VLDB 5.093636e-05
11,302 Snapcase – Regain Control over Your Predictions with Low-Latency Machine Unlearning 2024 VLDB 5.093636e-05
11,407 When Automatic Filtering Comes to the Rescue: Pre-Computing Company Competitor Pairs in Owler 2023 SIGMOD 5.093636e-05
11,669 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 5.093636e-05
11,842 Ariadne: Online Provenance for Big Graph Analytics 2019 SIGMOD 5.093636e-05
12,264 Functions Are Data Too (Defunctionalization for PL/SQL) 2013 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012250108
39 Efficiently Updating Materialized Views 1986 SIGMOD 0.00047309646
61 Maintaining Views Incrementally 1993 SIGMOD 0.00039026867
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
438 DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views 2012 VLDB 0.00018471721
2,196 Spinning Fast Iterative Data Flows 2012 VLDB 8.9704984e-05
2,454 REX: Recursive, Delta-Based Data-Centric Computation 2012 VLDB 8.5560058e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,534 Shared Arrangements: practical inter-query sharing for streaming dataflows 2020 VLDB
2 12,237 Iterative Parallel Data Processing with Stratosphere: An Inside Look 2013 SIGMOD
3 2,717 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
4 10,582 FlowLog: Efficient and Extensible Datalog via Incrementality 2026 VLDB
5 361 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB
6 5,567 iTurboGraph: Scaling and Automating Incremental Graph Analytics 2021 SIGMOD
7 1,911 Fast Iterative Graph Computation with Block Updates 2013 VLDB
8 10,103 Optimizing Differentially-Maintained Recursive Queries on Dynamic Graphs 2022 VLDB
9 4,845 Explaining Outputs in Modern Data Analytics 2016 VLDB
10 2,196 Spinning Fast Iterative Data Flows 2012 VLDB