Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka
Summary: Kafka's persistent log provides strong correctness under failures and out-of-order data. Kafka Streams uses read–process–write over log-append state with idempotent/transactional exactly-once and revision-based speculative processing for early results, enabling scalable correctness–performance–cost trade-offs. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Guozhang Wang (Confluent)
- 2. Lei Chen (Bloomberg)
- 3. Ayusman Dikshit (Expedia Group)
- 4. Jason Gustafson (Confluent)
- 5. Boyang Chen (Confluent)
- 6. Matthias J. Sax (Confluent)
- 7. John Roesler (Confluent)
- 8. Sophie Blee-Goldman (Confluent)
- 9. Bruno Cadonna (Confluent)
- 10. Apurva Mehta (Confluent)
- 11. Varun Madan (Confluent)
- 12. Jun Rao (Confluent)
BibTeX Citation
@inproceedings{wang_sigmod21,
title = {{Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka}},
author = {Wang, Guozhang and Chen, Lei and Dikshit, Ayusman and Gustafson, Jason and Chen, Boyang and Sax, Matthias J. and Roesler, John and Blee-Goldman, Sophie and Cadonna, Bruno and Mehta, Apurva and Madan, Varun and Rao, Jun},
series = {{SIGMOD} '21},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3448016.3457556},
url = {https://dl.acm.org/doi/10.1145/3448016.3457556},
year = {2021}
}Incoming Citations (Sorted by Pagerank)
Showing 7 of 7 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 5,939 | StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance | 2023 | VLDB | 5.9407099e-05 |
| 6,620 | Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow | 2021 | VLDB | 5.7315465e-05 |
| 7,267 | What's the Difference? Incremental Processing with Change Queries in Snowflake | 2023 | SIGMOD | 5.5698185e-05 |
| 8,542 | Serverless State Management Systems | 2024 | CIDR | 5.3189983e-05 |
| 9,648 | Disaggregated State Management in Apache Flink 2.0 | 2025 | VLDB | 5.1453267e-05 |
| 10,082 | DARQ Matter Binds Everything: Performant and Composable Cloud Programming via Resilient Steps | 2023 | SIGMOD | 5.0830849e-05 |
| 11,610 | Towards Millions of Database Transmission Services in the Cloud | 2024 | VLDB | 4.9793485e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 21 of 21 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next