DBScholar

Back to papers

Summingbird: A Framework for Integrating Batch and Online MapReduce Computations

Summary: Summingbird is a Scala DSL that runs one dataflow program across Hadoop batch and Storm online backends via interchangeable source/sink/store bindings. Algebraic aggregation constraints enable hybrid, up-to-date long-window results without duplicating analytics code. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
10992
Venue
VLDB
Year
2014
Pagerank
0.00010155021
Overall Rank
1,639 | 88.76%
DOI
10.14778/2733004.2733016

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boykin_vldb14,
        title = {{Summingbird: A Framework for Integrating Batch and Online MapReduce Computations}},
        author = {Boykin, Oscar and Ritchie, Sam and O'Connell, Ian and Lin, Jimmy},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {13},
        pages = {1441--1452},
        doi = {10.14778/2733004.2733016},
        url = {https://doi.org/10.14778/2733004.2733016},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
361 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020138717
612 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.0001573018
1,389 Realtime Data Processing at Facebook 2016 SIGMOD 0.00010943767
1,937 Elastic Machine Learning Algorithms in Amazon SageMaker 2020 SIGMOD 9.4524758e-05
2,935 RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark 2019 SIGMOD 7.9444531e-05
3,326 Timon: A Timestamped Event Database for Efficient Telemetry Data Processing and Analytics 2020 SIGMOD 7.5187553e-05
3,445 Sketching Linear Classifiers over Data Streams 2018 SIGMOD 7.4089141e-05
5,719 Optimal and General Out-of-Order Sliding-Window Aggregation 2019 VLDB 6.1094861e-05
6,685 Out of Many We are One: Measuring Item Batch with Clock-Sketch 2021 SIGMOD 5.8034001e-05
7,179 CleanM: An Optimizable Query Language for Unified Scale-Out Data Cleaning 2017 VLDB 5.6802479e-05
8,017 Data Management for Social Networking 2016 PODS 5.5064531e-05
9,468 Disaggregated State Management in Apache Flink 2.0 2025 VLDB 5.2634238e-05
11,914 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 5.093636e-05
12,008 CarStream: An Industrial System of Big Data Processing for Internet-of-Vehicles 2017 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010686205
167 Monitoring Streams – A New Class of Data Management Applications 2002 VLDB 0.0002757283
220 Storm @Twitter 2014 SIGMOD 0.00024244587
224 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024130894
1,171 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD 0.00011826434
1,353 SPADE: The System S Declarative Stream Processing Engine 2008 SIGMOD 0.00011061346
1,945 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD 9.4348569e-05
2,357 Muppet: MapReduce-Style Processing of Fast Data 2012 VLDB 8.7013171e-05
3,714 Large-Scale Machine Learning at Twitter 2012 SIGMOD 7.1764857e-05
4,169 The Unified Logging Infrastructure for Data Analytics at Twitter 2012 VLDB 6.8561463e-05
5,748 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 6.1014813e-05
7,010 Analytics for the Real-Time Web 2011 VLDB 5.7265965e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB
2 8,069 Execution Primitives for Scalable Joins and Aggregations in Map Reduce 2014 VLDB
3 939 Starling: A Scalable Query Engine on Cloud Functions 2020 SIGMOD
4 2,312 Online Aggregation and Continuous Query support in MapReduce 2010 SIGMOD
5 2,265 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
6 4,599 Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications 2018 SIGMOD
7 612 Twitter Heron: Stream Processing at Scale 2015 SIGMOD
8 2,717 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
9 11,700 In the Land of Data Streams where Synopses are Missing, One Framework to Bring Them All 2021 VLDB
10 11,914 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD