Scabbard: Single-Node Fault-Tolerant Stream Processing

Summary: Scabbard is the first single-node, multi-core SPE with exact-once fault tolerance under limited I/O, removing cluster recovery. Persistence is integrated in the operator graph, with parallel, marker-guided discard and workload-aware compression to sustain 200M tuples/s and sub-second recovery. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9c65487ce11a9fe7
Venue: VLDB
Year: 2022
Pagerank: 5.1233734e-05
Overall Rank: 9,817 | 34.02%
DOI: 10.14778/3489496.3489515
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Georgios Theodorakis (Imperial College London)
2. Fotios Kounelis (Imperial College London)
3. Peter Pietzuch (Imperial College London)
4. Holger Pirk (Imperial College London)

BibTeX Citation

@article{theodorakis_vldb22,
        title = {{Scabbard: Single-Node Fault-Tolerant Stream Processing}},
        author = {Theodorakis, Georgios and Kounelis, Fotios and Pietzuch, Peter and Pirk, Holger},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {2},
        pages = {361--374},
        doi = {10.14778/3489496.3489515},
        url = {https://doi.org/10.14778/3489496.3489515},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,552	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
21	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00056835296
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053906051
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.000408505
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00039236924
137	A Case for Redundant Arrays of Inexpensive Disks (RAID)	1988	SIGMOD	0.00029708689
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.00029001141
218	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024379041
231	Storm @Twitter	2014	SIGMOD	0.00023830094
436	Optimizing Space Amplification in RocksDB	2017	CIDR	0.00018312911
546	Faster: A Concurrent Key-Value Store with In-Place Updates	2018	SIGMOD	0.00016584272
594	Linear Road: A Stream Data Management Benchmark	2004	VLDB	0.00015816384
606	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015627966
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014778299
890	Rack-Scale In-Memory Join Processing using RDMA	2015	SIGMOD	0.00013241413
970	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012776109
1,123	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011926683
1,402	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010766851
3,108	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	7.6392673e-05
3,371	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.3659127e-05
3,398	Megaphone: Latency-conscious state migration for distributed streaming dataflows	2019	VLDB	7.3318754e-05
3,923	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB	6.919667e-05
4,046	Adaptive Query Processing in the Looking Glass	2005	CIDR	6.8297725e-05
4,110	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	6.797656e-05
4,310	Consistent Regions: Guaranteed Tuple Processing in IBM Streams	2016	VLDB	6.6700421e-05
4,867	Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows	2021	SIGMOD	6.3723904e-05
4,919	LightSaber: Efficient Window Aggregation on Multi-core Processors	2020	SIGMOD	6.3519157e-05
5,331	BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures	2019	SIGMOD	6.1770377e-05
6,444	Grizzly: Efficient Stream Processing Through Adaptive Query Compilation	2020	SIGMOD	5.7807677e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,601	AStream: Ad-hoc Shared Stream Processing	2019	SIGMOD
2	1,829	Fault-Tolerance in the Borealis Distributed Stream Processing System	2005	SIGMOD
3	10,273	Darwin: Scale-In Stream Processing	2022	CIDR
4	3,923	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB
5	1,771	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB
6	4,453	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD
7	11,445	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB
8	12,323	Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance	2017	VLDB
9	970	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
10	3,792	Fault-tolerant Stream Processing using a Distributed, Replicated File System	2008	VLDB