Correctness in Stream Processing: Challenges and Opportunities

Summary: Documents correctness challenges in distributed real-time stream processing—engineering and performance advances outpaced formal correctness, leading to hard-to-detect, catastrophic errors in platforms like Storm, Flink, Spark. Advocates rigorous formalization and formal-methods-based verification of stream processing programs and systems. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 439
Venue: CIDR
Year: 2022
Pagerank: 4.6089395e-05
Overall Rank: 7,941 | 44.82%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,866	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
524	Differential dataflow	2013	CIDR	0.00021093133
1,097	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014083973
1,362	Highly Available, Fault-Tolerant, Parallel Dataflows	2004	SIGMOD	0.00012380613
1,546	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011418993
1,995	Fault-Tolerance in the Borealis Distributed Stream Processing System	2005	SIGMOD	9.83817e-05
2,339	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.0029559e-05
4,797	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	5.9101178e-05
5,942	Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows	2021	SIGMOD	5.2591128e-05
11,438	Synchronization Schemas	2021	PODS	4.1905499e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
12,117	Declarative Error Management for Robust Data-Intensive Applications	2012	SIGMOD	4.1905499e-05
13,480	Verifying Computations with Streaming Interactive Proofs	2012	VLDB	-
11,438	Synchronization Schemas	2021	PODS	4.1905499e-05
1,481	Automating Large-Scale Data Quality Verification	2018	VLDB	0.00011715754
4,824	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD	5.8902451e-05
536	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020651621
5,131	One SQL to Rule Them All – an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables	2019	SIGMOD	5.6704313e-05
1,546	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011418993
10,866	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB	4.1905499e-05
6,769	Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow	2021	VLDB	4.9274854e-05