DBScholar

Back to papers

Storm @Twitter

Summary: Describes Storm, a real-time, fault-tolerant distributed stream processing system deployed at Twitter at scale. Covers architecture, topology execution, scale-out, and fault tolerance, with empirical resilience data and production-time lessons. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h7277c146d00b40fe
Venue
SIGMOD
Year
2014
Pagerank
0.00023841089
Overall Rank
231 | 98.45%
DOI
10.1145/2588555.2595641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{toshniwal_sigmod14,
        title = {{Storm @Twitter}},
        author = {Toshniwal, Ankit and Taneja, Siddarth and Shukla, Amit and Ramasamy, Karthik and Patel, Jignesh M. and Kulkarni, Sanjeev and Jackson, Jason and Gade, Krishna and Fu, Maosong and Donham, Jake and Bhagat, Nikunj and Mittal, Sailesh and Ryaboy, Dmitriy},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2595641},
        url = {https://dl.acm.org/doi/10.1145/2588555.2595641},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 24 of 74 citing papers.

Rank Citing Paper Year Venue Pagerank
9,916 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.1103839e-05
10,084 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 5.0830849e-05
10,158 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 5.0706053e-05
10,329 Distributed Stream KNN Join 2021 SIGMOD 5.0333462e-05
10,541 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.9793485e-05
10,927 A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs 2026 VLDB 4.9793485e-05
11,129 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 4.9793485e-05
11,439 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB 4.9793485e-05
11,521 Fault Tolerance Placement in the Internet of Things 2024 SIGMOD 4.9793485e-05
11,676 Templating Shuffles 2023 CIDR 4.9793485e-05
11,940 Synchronization Schemas 2021 PODS 4.9793485e-05
11,972 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.9793485e-05
12,100 Demand-based Sensor Data Gathering with Multi-Query Optimization 2020 VLDB 4.9793485e-05
12,168 Online Template Induction for Machine-Generated Emails 2019 VLDB 4.9793485e-05
12,213 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 4.9793485e-05
12,232 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.9793485e-05
12,277 Query Processing Techniques for Big Spatial-Keyword Data 2017 SIGMOD 4.9793485e-05
12,298 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB 4.9793485e-05
12,302 Query-able Kafka: An agile data analytics pipeline for mobile wireless networks 2017 VLDB 4.9793485e-05
12,342 Real-time Video Recommendation Exploration 2016 SIGMOD 4.9793485e-05
12,345 The Challenges of Global-scale Data Management 2016 SIGMOD 4.9793485e-05
12,353 dmapply: A functional primitive to express distributed machine learning algorithms in R 2016 VLDB 4.9793485e-05
12,401 CE-Storm: Confidential Elastic Processing of Data Streams 2015 SIGMOD 4.9793485e-05
12,419 CANDS: Continuous Optimal Navigation via Distributed Stream Processing 2015 VLDB 4.9793485e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
93 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034622929
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030427614
218 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024390324
1,175 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD 0.00011649474
1,290 Querying and Mining Data Streams: You Only Get One Look 2002 SIGMOD 0.00011157506
1,750 Towards a Streaming SQL Standard 2008 VLDB 9.7311887e-05
2,876 Continuous Queries in Oracle 2007 VLDB 7.9187241e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,828 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD
2 1,828 Fault-Tolerance in the Borealis Distributed Stream Processing System 2005 SIGMOD
3 12,317 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB
4 12,401 CE-Storm: Confidential Elastic Processing of Data Streams 2015 SIGMOD
5 4,777 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD
6 12,405 STORM: Spatio-Temporal Online Reasoning and Management of Large Spatio-Temporal Data 2015 SIGMOD
7 12,546 Resa: Realtime Elastic Streaming Analytics in the Cloud 2013 SIGMOD
8 7,767 Squall: Scalable Real-time Analytics 2016 VLDB
9 7,933 Tornado: A Distributed Spatio-Textual Stream Processing System 2015 VLDB
10 606 Twitter Heron: Stream Processing at Scale 2015 SIGMOD