Accelerating Stream Processing Engines via Hardware Offloading

Summary: FlexStream offloads re-partitioning to hardware and adopts a coupled network-executor model to saturate NIC bandwidth and rethink SPE parallelization. With a lock-free state backend and fast migration it achieves 1.95–3.35× throughput and much lower latency spikes and migration time versus prior SPEs. (summarized by gpt-5-mini on Feb 11 2026)

Paper ID: h15f26678409b9986
Venue: SIGMOD
Year: 2026
Pagerank: 4.9605343e-05
Overall Rank: 10,617 | 28.84%
DOI: 10.1145/3769754
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Zhengyan Guo (Tsinghua University)
2. Mingxing Zhang (Tsinghua University)
3. Yingdi Shan (Tsinghua University)
4. Kang Chen (Tsinghua University)
5. Jinlei Jiang (Tsinghua University)
6. Yongwei Wu (Tsinghua University)

BibTeX Citation

@inproceedings{guo_sigmod26,
        title = {{Accelerating Stream Processing Engines via Hardware Offloading}},
        author = {Guo, Zhengyan and Zhang, Mingxing and Shan, Yingdi and Chen, Kang and Jiang, Jinlei and Wu, Yongwei},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3769754},
        url = {https://dl.acm.org/doi/10.1145/3769754},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
215	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00024554257
233	Storm @Twitter	2014	SIGMOD	0.00023754096
607	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015577054
973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012734154
1,244	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011363001
3,409	Megaphone: Latency-conscious state migration for distributed streaming dataflows	2019	VLDB	7.3076317e-05
3,939	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB	6.8967981e-05
4,129	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	6.7751787e-05
4,942	LightSaber: Efficient Window Aggregation on Multi-core Processors	2020	SIGMOD	6.3309707e-05
5,347	BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures	2019	SIGMOD	6.1566135e-05
6,456	Grizzly: Efficient Stream Processing Through Adaptive Query Compilation	2020	SIGMOD	5.7616575e-05
6,635	Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow	2021	VLDB	5.7098902e-05
7,996	Rethinking Stateful Stream Processing with RDMA	2022	SIGMOD	5.3941543e-05
9,511	Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing	2019	SIGMOD	5.1516241e-05
9,851	Scabbard: Single-Node Fault-Tolerant Stream Processing	2022	VLDB	5.1064323e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,580	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD
2	4,942	LightSaber: Efficient Window Aggregation on Multi-core Processors	2020	SIGMOD
3	8,012	From a Stream of Relational Queries to Distributed Stream Processing	2010	VLDB
4	9,675	Providing Resiliency to Load Variations in Distributed Stream Processing	2006	VLDB
5	8,442	Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing	2025	SIGMOD
6	7,996	Rethinking Stateful Stream Processing with RDMA	2022	SIGMOD
7	2,453	Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core	2006	SIGMOD
8	9,511	Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing	2019	SIGMOD
9	6,553	A Holistic View of Stream Partitioning Costs	2017	VLDB
10	3,939	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB