DBScholar

Back to papers

Storm @Twitter

Summary: Describes Storm, a real-time, fault-tolerant distributed stream processing system deployed at Twitter at scale. Covers architecture, topology execution, scale-out, and fault tolerance, with empirical resilience data and production-time lessons. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4920
Venue
SIGMOD
Year
2014
Pagerank
0.00024244587
Overall Rank
220 | 98.50%
DOI
10.1145/2588555.2595641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{toshniwal_sigmod14,
        title = {{Storm @Twitter}},
        author = {Toshniwal, Ankit and Taneja, Siddarth and Shukla, Amit and Ramasamy, Karthik and Patel, Jignesh M. and Kulkarni, Sanjeev and Jackson, Jason and Gade, Krishna and Fu, Maosong and Donham, Jake and Bhagat, Nikunj and Mittal, Sailesh and Ryaboy, Dmitriy},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2595641},
        url = {https://dl.acm.org/doi/10.1145/2588555.2595641},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 73 citing papers.

Rank Citing Paper Year Venue Pagerank
9,898 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 5.1997534e-05
9,968 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 5.1869874e-05
10,102 Distributed Stream KNN Join 2021 SIGMOD 5.1488731e-05
10,337 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 5.093636e-05
10,695 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 5.093636e-05
11,086 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB 5.093636e-05
11,176 Fault Tolerance Placement in the Internet of Things 2024 SIGMOD 5.093636e-05
11,360 Templating Shuffles 2023 CIDR 5.093636e-05
11,633 Synchronization Schemas 2021 PODS 5.093636e-05
11,665 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 5.093636e-05
11,798 Demand-based Sensor Data Gathering with Multi-Query Optimization 2020 VLDB 5.093636e-05
11,820 InvaliDB: Scalable Push-Based Real-Time Queries on Top of Pull-Based Databases (Extended) 2020 VLDB 5.093636e-05
11,868 Online Template Induction for Machine-Generated Emails 2019 VLDB 5.093636e-05
11,914 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 5.093636e-05
11,933 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 5.093636e-05
11,979 Query Processing Techniques for Big Spatial-Keyword Data 2017 SIGMOD 5.093636e-05
12,001 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB 5.093636e-05
12,006 Query-able Kafka: An agile data analytics pipeline for mobile wireless networks 2017 VLDB 5.093636e-05
12,047 Real-time Video Recommendation Exploration 2016 SIGMOD 5.093636e-05
12,050 The Challenges of Global-scale Data Management 2016 SIGMOD 5.093636e-05
12,060 dmapply: A functional primitive to express distributed machine learning algorithms in R 2016 VLDB 5.093636e-05
12,108 CE-Storm: Confidential Elastic Processing of Data Streams 2015 SIGMOD 5.093636e-05
12,126 CANDS: Continuous Optimal Navigation via Distributed Stream Processing 2015 VLDB 5.093636e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
98 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034510605
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030738755
224 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024130894
1,171 Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams 2013 SIGMOD 0.00011826434
1,274 Querying and Mining Data Streams: You Only Get One Look 2002 SIGMOD 0.00011377527
1,718 Towards a Streaming SQL Standard 2008 VLDB 9.9297933e-05
2,838 Continuous Queries in Oracle 2007 VLDB 8.0685625e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,748 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD
2 1,789 Fault-Tolerance in the Borealis Distributed Stream Processing System 2005 SIGMOD
3 12,022 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB
4 12,108 CE-Storm: Confidential Elastic Processing of Data Streams 2015 SIGMOD
5 4,686 Tornado: A System For Real-Time Iterative Analysis Over Evolving Data 2016 SIGMOD
6 12,112 STORM: Spatio-Temporal Online Reasoning and Management of Large Spatio-Temporal Data 2015 SIGMOD
7 12,255 Resa: Realtime Elastic Streaming Analytics in the Cloud 2013 SIGMOD
8 7,617 Squall: Scalable Real-time Analytics 2016 VLDB
9 7,794 Tornado: A Distributed Spatio-Textual Stream Processing System 2015 VLDB
10 612 Twitter Heron: Stream Processing at Scale 2015 SIGMOD