How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems

Summary: PGVal end-to-end validates stream-processing guarantees via fault injection and a comprehensive failure model. New metrics—reliability, reliable throughput, failure cost, and refined latency—expose configuration- and fault-dependent tradeoffs in Kafka Streams, Storm, and Flink. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 14408
Venue: VLDB
Year: 2025
Pagerank: 5.093636e-05
Overall Rank: 11,086 | 23.95%
DOI: 10.14778/3712221.3712227

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Jawad Tahir (Technical University of Munich)
2. Ruben Mayer (University of Bayreuth)
3. Christoph Doblander (Technical University of Munich)
4. Hans-Arno Jacobsen (University of Toronto)

BibTeX Citation

@article{tahir_vldb25,
        title = {{How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems}},
        author = {Tahir, Jawad and Mayer, Ruben and Doblander, Christoph and Jacobsen, Hans-Arno},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {3},
        pages = {585--598},
        doi = {10.14778/3712221.3712227},
        url = {https://doi.org/10.14778/3712221.3712227},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
220	Storm @Twitter	2014	SIGMOD	0.00024244587
361	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020138717
587	Linear Road: A Stream Data Management Benchmark	2004	VLDB	0.00016106078
8,248	Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing	2025	SIGMOD	5.4574671e-05
8,258	Correctness in Stream Processing: Challenges and Opportunities	2022	CIDR	5.4574671e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,393	Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core	2006	SIGMOD
2	1,789	Fault-Tolerance in the Borealis Distributed Stream Processing System	2005	SIGMOD
3	6,502	Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow	2021	VLDB
4	3,776	Fault-tolerant Stream Processing using a Distributed, Replicated File System	2008	VLDB
5	8,258	Correctness in Stream Processing: Challenges and Opportunities	2022	CIDR
6	1,422	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB
7	983	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
8	12,022	Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance	2017	VLDB
9	8,248	Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing	2025	SIGMOD
10	4,389	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD