Correctness in Stream Processing: Challenges and Opportunities

Summary: Documents correctness challenges in distributed real-time stream processing—engineering and performance advances outpaced formal correctness, leading to hard-to-detect, catastrophic errors in platforms like Storm, Flink, Spark. Advocates rigorous formalization and formal-methods-based verification of stream processing programs and systems. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 439
Venue: CIDR
Year: 2022
Pagerank: 4.613363e-05
Overall Rank: 7,938 | 44.78%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,862	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
522	Differential dataflow	2013	CIDR	0.00021099241
1,098	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014114442
1,357	Highly Available, Fault-Tolerant, Parallel Dataflows	2004	SIGMOD	0.00012392275
1,548	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011431383
1,990	Fault-Tolerance in the Borealis Distributed Stream Processing System	2005	SIGMOD	9.8472819e-05
2,338	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.00711e-05
4,795	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	5.9158043e-05
5,939	Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows	2021	SIGMOD	5.2641681e-05
11,435	Synchronization Schemas	2021	PODS	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
12,109	Declarative Error Management for Robust Data-Intensive Applications	2012	SIGMOD	4.1945683e-05
13,467	Verifying Computations with Streaming Interactive Proofs	2012	VLDB	-
11,435	Synchronization Schemas	2021	PODS	4.1945683e-05
1,482	Automating Large-Scale Data Quality Verification	2018	VLDB	0.00011725533
4,822	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD	5.8959131e-05
538	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020678804
5,130	One SQL to Rule Them All – an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables	2019	SIGMOD	5.6755067e-05
1,548	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011431383
10,862	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB	4.1945683e-05
6,767	Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow	2021	VLDB	4.9322174e-05