DBScholar

Back to papers

Samza: Stateful Scalable Stream Processing at LinkedIn

Summary: Samza scales stateful stream processing via partitioned local state and low-overhead changelogs, with host-affinity recovery independent of state size. It unifies live and finite-stream processing/replay, enabling fast reprocessing with minimal real-time interference. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11634
Venue
VLDB
Year
2017
Pagerank
9.5260291e-05
Overall Rank
1,895 | 87.01%
DOI
10.14778/3137765.3137770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{noghabi_vldb17,
        title = {{Samza: Stateful Scalable Stream Processing at LinkedIn}},
        author = {Noghabi, Shadi A. and Paramasivam, Kartik and Pan, Yi and Ramesh, Navina and Bringhurst, Jon and Gupta, Indranil and Campbell, Roy H.},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {12},
        pages = {1634--1647},
        doi = {10.14778/3137765.3137770},
        url = {https://doi.org/10.14778/3137765.3137770},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank Citing Paper Year Venue Pagerank
3,326 Timon: A Timestamped Event Database for Efficient Telemetry Data Processing and Analytics 2020 SIGMOD 7.5187553e-05
4,279 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.7865878e-05
4,389 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.7304854e-05
5,756 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.097233e-05
6,108 Providing Streaming Joins as a Service at Facebook 2018 VLDB 5.9730511e-05
6,344 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.9060457e-05
6,680 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.8049764e-05
6,684 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.8036476e-05
7,049 MgCrab: Transaction Crabbing for Live Migration in Deterministic Database Systems 2019 VLDB 5.7177768e-05
7,294 Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile 2021 VLDB 5.6532162e-05
8,258 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.4574671e-05
8,309 Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines 2020 SIGMOD 5.4560857e-05
9,064 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.3251649e-05
9,336 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 5.2878276e-05
9,468 Disaggregated State Management in Apache Flink 2.0 2025 VLDB 5.2634238e-05
9,738 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.227679e-05
9,898 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 5.1997534e-05
9,968 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 5.1869874e-05
10,782 Styx: Transactional Stateful Functions on Streaming Dataflows 2025 SIGMOD 5.093636e-05
11,176 Fault Tolerance Placement in the Internet of Things 2024 SIGMOD 5.093636e-05
11,633 Synchronization Schemas 2021 PODS 5.093636e-05
11,868 Online Template Induction for Machine-Generated Emails 2019 VLDB 5.093636e-05
11,933 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010686205
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030738755
220 Storm @Twitter 2014 SIGMOD 0.00024244587
224 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024130894
361 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020138717
612 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.0001573018
983 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.0001283214
1,915 S-Store: Streaming Meets Transaction Processing 2015 VLDB 9.4884706e-05
1,999 On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform 2013 SIGMOD 9.3349118e-05
3,963 Solving Big Data Challenges for Enterprise Application Performance Management 2012 VLDB 6.9864509e-05
4,278 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 6.7871785e-05
5,035 Run-Time Operator State Spilling for Memory Intensive Long-Running Queries 2006 SIGMOD 6.3920216e-05
6,734 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.7879923e-05
8,401 Ambry: LinkedIn's Scalable Geo-Distributed Object Store 2016 SIGMOD 5.4331587e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,086 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB
2 11,018 Ursa: A Lakehouse-Native Data Streaming Engine for Kafka 2025 VLDB
3 12,022 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB
4 6,734 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR
5 4,279 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD
6 5,419 Building a Replicated Logging System with Apache Kafka 2015 VLDB
7 9,633 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB
8 983 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
9 4,389 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD
10 1,422 State Management in Apache Flink: Consistent Stateful Distributed Stream Processing 2017 VLDB