Database Paper Browser

Back to papers

Twitter Heron: Stream Processing at Scale

Summary: Introduces Heron, a real-time stream engine to replace Storm at Twitter, addressing scale, debuggability, performance, and manageability. Design insights and empirical evidence of efficiency and scalability as Twitter’s de facto streaming backend. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5014
Venue
SIGMOD
Year
2015
Pagerank
0.00016226851
Overall Rank
822 | 94.29%
DOI
10.1145/2723372.2723374

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank Citing Paper Year Venue Pagerank
1,081 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00014201838
1,616 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011133818
2,339 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.0029559e-05
2,832 Regular Path Query Evaluation on Streaming Graphs 2020 SIGMOD 8.048358e-05
3,216 Frontier: Resilient Edge Processing for the Internet of Things 2018 VLDB 7.3675613e-05
3,363 Lethe: A Tunable Delete-Aware LSM Engine 2020 SIGMOD 7.1680649e-05
3,551 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 6.9776252e-05
3,645 Autoscaling Tiered Cloud Storage in Anna 2019 VLDB 6.882432e-05
3,703 How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates 2016 SIGMOD 6.8249334e-05
4,387 LogStore: A Cloud-Native and Multi-Tenant Log Database 2021 SIGMOD 6.2219283e-05
5,271 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 5.5924143e-05
5,670 BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures 2019 SIGMOD 5.3799054e-05
5,740 TcpRT: Instrument and Diagnostic Analysis System for Service Quality of Cloud Databases at Massive Scale in Real-time 2018 SIGMOD 5.3451127e-05
5,942 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 5.2591128e-05
6,128 Data Ingestion for the Connected World 2017 CIDR 5.1943896e-05
6,489 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.0373773e-05
6,628 A Holistic View of Stream Partitioning Costs 2017 VLDB 4.9833118e-05
7,371 Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile 2021 VLDB 4.744863e-05
7,629 Incremental Sliding Window Connectivity over Streaming Graphs 2024 VLDB 4.6883161e-05
7,748 TSCache: An Efficient Flash-based Caching Scheme for Time-series Data Workloads 2021 VLDB 4.6571687e-05
7,864 Operational Analytics Data Management Systems 2016 VLDB 4.6284093e-05
7,926 Data Management for Social Networking 2016 PODS 4.6107647e-05
8,214 Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines 2020 SIGMOD 4.5524768e-05
8,925 Enabling Signal Processing over Data Streams 2017 SIGMOD 4.4229886e-05
9,191 POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance 2024 VLDB 4.3738237e-05
9,220 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 4.3670162e-05
9,497 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 4.3300131e-05
9,502 Dhalion in Action: Automatic Management of Streaming Applications 2018 VLDB 4.3300131e-05
9,732 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 4.2901665e-05
9,806 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 4.2766788e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1905499e-05
10,292 Meerkat: Scalable, Network-Aware Failure Recovery for the Internet of Things 2026 VLDB 4.1905499e-05
10,965 Fault Tolerance Placement in the Internet of Things 2024 SIGMOD 4.1905499e-05
11,438 Synchronization Schemas 2021 PODS 4.1905499e-05
11,471 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.1905499e-05
11,489 Real-time Data Infrastructure at Uber 2021 SIGMOD 4.1905499e-05
11,629 InvaliDB: Scalable Push-Based Real-Time Queries on Top of Pull-Based Databases (Extended) 2020 VLDB 4.1905499e-05
11,678 Online Template Induction for Machine-Generated Emails 2019 VLDB 4.1905499e-05
11,715 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.1905499e-05
11,734 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.1905499e-05
11,782 Query Processing Techniques for Big Spatial-Keyword Data 2017 SIGMOD 4.1905499e-05
11,813 CarStream: An Industrial System of Big Data Processing for Internet-of-Vehicles 2017 VLDB 4.1905499e-05
11,815 Upsortable: Programming Top-K Queries Over Data Streams 2017 VLDB 4.1905499e-05
11,827 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB 4.1905499e-05
11,857 The Challenges of Global-scale Data Management 2016 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
287 Storm @Twitter 2014 SIGMOD 0.00028917909
314 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00028059664
1,222 Querying and Mining Data Streams: You Only Get One Look 2002 SIGMOD 0.00013205769
1,284 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD 0.00012820565
1,793 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010522029
2,601 Continuous Queries in Oracle 2007 VLDB 8.4646467e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
1,793 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010522029
1,616 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011133818
7,578 Squall: Scalable Real-time Analytics 2016 VLDB 4.702646e-05
4,563 The Unified Logging Infrastructure for Data Analytics at Twitter 2012 VLDB 6.0752535e-05
11,715 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.1905499e-05
6,135 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 5.1908958e-05
12,065 Resa: Realtime Elastic Streaming Analytics in the Cloud 2013 SIGMOD 4.1905499e-05
8,018 Tornado: A Distributed Spatio-Textual Stream Processing System 2015 VLDB 4.6014254e-05
1,081 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00014201838
287 Storm @Twitter 2014 SIGMOD 0.00028917909