Scabbard: Single-Node Fault-Tolerant Stream Processing

Summary: Scabbard is the first single-node, multi-core SPE with exact-once fault tolerance under limited I/O, removing cluster recovery. Persistence is integrated in the operator graph, with parallel, marker-guided discard and workload-aware compression to sustain 200M tuples/s and sub-second recovery. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9c65487ce11a9fe7
Venue: VLDB
Year: 2022
Pagerank: 5.1064323e-05
Overall Rank: 9,851 | 33.97%
DOI: 10.14778/3489496.3489515
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Georgios Theodorakis (Imperial College London)
2. Fotios Kounelis (Imperial College London)
3. Peter Pietzuch (Imperial College London)
4. Holger Pirk (Imperial College London)

BibTeX Citation

@article{theodorakis_vldb22,
        title = {{Scabbard: Single-Node Fault-Tolerant Stream Processing}},
        author = {Theodorakis, Georgios and Kounelis, Fotios and Pietzuch, Peter and Pirk, Holger},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {2},
        pages = {361--374},
        doi = {10.14778/3489496.3489515},
        url = {https://doi.org/10.14778/3489496.3489515},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,617	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
21	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00056737487
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053734242
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.00040739114
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00039323387
137	A Case for Redundant Arrays of Inexpensive Disks (RAID)	1988	SIGMOD	0.00029612709
147	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.00028941363
219	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.0002429959
233	Storm @Twitter	2014	SIGMOD	0.00023754096
438	Optimizing Space Amplification in RocksDB	2017	CIDR	0.00018259155
549	Faster: A Concurrent Key-Value Store with In-Place Updates	2018	SIGMOD	0.00016530268
596	Linear Road: A Stream Data Management Benchmark	2004	VLDB	0.00015766455
607	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015577054
688	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014736145
885	Rack-Scale In-Memory Join Processing using RDMA	2015	SIGMOD	0.00013222753
973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012734154
1,128	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011887295
1,409	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010732706
3,117	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	7.6142606e-05
3,380	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.3415892e-05
3,409	Megaphone: Latency-conscious state migration for distributed streaming dataflows	2019	VLDB	7.3076317e-05
3,939	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB	6.8967981e-05
4,069	Adaptive Query Processing in the Looking Glass	2005	CIDR	6.8080574e-05
4,129	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	6.7751787e-05
4,327	Consistent Regions: Guaranteed Tuple Processing in IBM Streams	2016	VLDB	6.6480683e-05
4,889	Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows	2021	SIGMOD	6.3513193e-05
4,942	LightSaber: Efficient Window Aggregation on Multi-core Processors	2020	SIGMOD	6.3309707e-05
5,347	BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures	2019	SIGMOD	6.1566135e-05
6,456	Grizzly: Efficient Stream Processing Through Adaptive Query Compilation	2020	SIGMOD	5.7616575e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,607	AStream: Ad-hoc Shared Stream Processing	2019	SIGMOD
2	10,300	Darwin: Scale-In Stream Processing	2022	CIDR
3	1,841	Fault-Tolerance in the Borealis Distributed Stream Processing System	2005	SIGMOD
4	3,939	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB
5	1,785	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB
6	4,475	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD
7	11,497	How Reliable Are Streams? End-to-End Processing-Guarantee Validation and Performance Benchmarking of Stream Processing Systems	2025	VLDB
8	12,366	Toward High-Performance Distributed Stream Processing via Approximate Fault Tolerance	2017	VLDB
9	973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
10	3,801	Fault-tolerant Stream Processing using a Distributed, Replicated File System	2008	VLDB