DBScholar

Back to papers

Samza: Stateful Scalable Stream Processing at LinkedIn

Summary: Samza scales stateful stream processing via partitioned local state and low-overhead changelogs, with host-affinity recovery independent of state size. It unifies live and finite-stream processing/replay, enabling fast reprocessing with minimal real-time interference. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h860f458fdc9decaa
Venue
VLDB
Year
2017
Pagerank
9.6803752e-05
Overall Rank
1,771 | 88.10%
DOI
10.14778/3137765.3137770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{noghabi_vldb17,
        title = {{Samza: Stateful Scalable Stream Processing at LinkedIn}},
        author = {Noghabi, Shadi A. and Paramasivam, Kartik and Pan, Yi and Ramesh, Navina and Bringhurst, Jon and Gupta, Indranil and Campbell, Roy H.},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {12},
        pages = {1634--1647},
        doi = {10.14778/3137765.3137770},
        url = {https://doi.org/10.14778/3137765.3137770},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
3,382 Timon: A Timestamped Event Database for Efficient Telemetry Data Processing and Analytics 2020 SIGMOD 7.3559487e-05
4,109 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.8008755e-05
4,450 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.594912e-05
4,866 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.3754084e-05
6,225 Providing Streaming Joins as a Service at Facebook 2018 VLDB 5.8455305e-05
6,266 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.8303329e-05
6,450 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.7817872e-05
6,787 Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile 2021 VLDB 5.6820544e-05
6,814 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.6735614e-05
7,179 MgCrab: Transaction Crabbing for Live Migration in Deterministic Database Systems 2019 VLDB 5.5930043e-05
7,267 What's the Difference? Incremental Processing with Change Queries in Snowflake 2023 SIGMOD 5.5698185e-05
8,404 Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines 2020 SIGMOD 5.3385814e-05
8,424 Correctness in Stream Processing: Challenges and Opportunities 2022 CIDR 5.3350162e-05
9,471 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 5.1711628e-05
9,648 Disaggregated State Management in Apache Flink 2.0 2025 VLDB 5.1453267e-05
9,916 GeaFlow: A Graph Extended and Accelerated Dataflow System 2023 SIGMOD 5.1103839e-05
10,084 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 5.0830849e-05
10,158 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 5.0706053e-05
10,927 A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs 2026 VLDB 4.9793485e-05
11,036 The Dataflow Model Revisited Or: That Feeling When You Realize Every Problem You've Been Solving Is a Database Problem 2026 VLDB 4.9793485e-05
11,199 Styx: Transactional Stateful Functions on Streaming Dataflows 2025 SIGMOD 4.9793485e-05
11,521 Fault Tolerance Placement in the Internet of Things 2024 SIGMOD 4.9793485e-05
11,940 Synchronization Schemas 2021 PODS 4.9793485e-05
12,168 Online Template Induction for Machine-Generated Emails 2019 VLDB 4.9793485e-05
12,232 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.001052036
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049839909
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030427614
218 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024390324
231 Storm @Twitter 2014 SIGMOD 0.00023841089
325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020964941
606 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.00015635133
968 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00012782051
1,938 S-Store: Streaming Meets Transaction Processing 2015 VLDB 9.3342542e-05
2,013 On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform 2013 SIGMOD 9.1862445e-05
3,787 Solving Big Data Challenges for Enterprise Application Performance Management 2012 VLDB 7.0207119e-05
4,309 Consistent Regions: Guaranteed Tuple Processing in IBM Streams 2016 VLDB 6.6732011e-05
5,103 Run-Time Operator State Spilling for Memory Intensive Long-Running Queries 2006 SIGMOD 6.2724506e-05
6,819 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.672617e-05
8,573 Ambry: LinkedIn's Scalable Geo-Distributed Object Store 2016 SIGMOD 5.3122857e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,439 How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems 2025 VLDB
2 11,383 Ursa: A Lakehouse-Native Data Streaming Engine for Kafka 2025 VLDB
3 12,317 Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance 2017 VLDB
4 4,109 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD
5 6,819 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR
6 5,027 Building a Replicated Logging System with Apache Kafka 2015 VLDB
7 9,810 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB
8 968 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
9 4,450 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD
10 1,402 State Management in Apache Flink: Consistent Stateful Distributed Stream Processing 2017 VLDB