Building a Replicated Logging System with Apache Kafka
Summary: Replicated logging backbone on Kafka's distributed commit log extends its use from messaging to data storage and processing. Draws on LinkedIn's design and engineering experience to replicate Kafka logs for source-of-truth storage and stream processing. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Guozhang Wang (LinkedIn)
- 2. Joel Koshy (LinkedIn)
- 3. Sriram Subramanian (LinkedIn)
- 4. Kartik Paramasivam (LinkedIn)
- 5. Mammad Zadeh (LinkedIn)
- 6. Neha Narkhede (Confluent)
- 7. Jun Rao (Confluent)
- 8. Jay Kreps (Confluent)
- 9. Joe Stein (Big Data Open Source Security LLC)
BibTeX Citation
@article{wang_vldb15,
title = {{Building a Replicated Logging System with Apache Kafka}},
author = {Wang, Guozhang and Koshy, Joel and Subramanian, Sriram and Paramasivam, Kartik and Zadeh, Mammad and Narkhede, Neha and Rao, Jun and Kreps, Jay and Stein, Joe},
journal = {PVLDB},
series = {{VLDB} '15},
volume = {8},
number = {12},
pages = {1654--1655},
doi = {10.14778/2824032.2824075},
url = {https://doi.org/10.14778/2824032.2824075},
year = {2015}
}Incoming Citations (Sorted by Pagerank)
Showing 7 of 7 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 4,389 | Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka | 2021 | SIGMOD | 6.7304854e-05 |
| 5,756 | Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows | 2021 | SIGMOD | 6.097233e-05 |
| 6,482 | AStream: Ad-hoc Shared Stream Processing | 2019 | SIGMOD | 5.8668582e-05 |
| 7,905 | Amazon MemoryDB: A Fast and Durable Memory-First Cloud Database | 2024 | SIGMOD | 5.5181056e-05 |
| 7,975 | Lotus: Scalable Multi-Partition Transactions on Single-Threaded Partitioned Databases | 2022 | VLDB | 5.515614e-05 |
| 10,818 | Evaluating Continuous Queries with Inconsistency Annotations | 2025 | VLDB | 5.093636e-05 |
| 11,558 | KafkaDirect: Zero-copy Data Access for Apache Kafka over RDMA Networks | 2022 | SIGMOD | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 1 of 1 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,999 | On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform | 2013 | SIGMOD | 9.3349118e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,422 | State Management in Apache Flink: Consistent Stateful Distributed Stream Processing | 2017 | VLDB |
| 2 | 6,734 | Liquid: Unifying Nearline and Offline Big Data Integration | 2015 | CIDR |
| 3 | 1,999 | On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform | 2013 | SIGMOD |
| 4 | 6,004 | Data Ingestion for the Connected World | 2017 | CIDR |
| 5 | 11,763 | Rethinking Message Brokers on RDMA and NVM | 2020 | SIGMOD |
| 6 | 1,895 | Samza: Stateful Scalable Stream Processing at LinkedIn | 2017 | VLDB |
| 7 | 12,006 | Query-able Kafka: An agile data analytics pipeline for mobile wireless networks | 2017 | VLDB |
| 8 | 9,562 | Kora: A Cloud-Native Event Streaming Platform For Kafka | 2023 | VLDB |
| 9 | 11,558 | KafkaDirect: Zero-copy Data Access for Apache Kafka over RDMA Networks | 2022 | SIGMOD |
| 10 | 4,389 | Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka | 2021 | SIGMOD |