DBScholar

Back to papers

Analyzing Efficient Stream Processing on Modern Hardware

Summary: Evaluates SPEs on modern hardware, revealing underutilization of multicore CPUs and fast networks in shared-nothing designs. Proposes hardware-aware optimizations—code generation, operator fusion, batch parallelism, and windowing—that yield up to 100x single-node throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h48996f8509cfd077
Venue
VLDB
Year
2019
Pagerank
6.919667e-05
Overall Rank
3,923 | 73.64%
DOI
10.14778/3303753.3303758
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zeuch_vldb19,
        title = {{Analyzing Efficient Stream Processing on Modern Hardware}},
        author = {Zeuch, Steffen and Del Monte, Bonaventura and Karimov, Jeyhun and Lutz, Clemens and Renz, Manuel and Traub, Jonas and Breß, Sebastian and Rabl, Tilmann and Markl, Volker},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {5},
        pages = {516--530},
        doi = {10.14778/3303753.3303758},
        url = {https://doi.org/10.14778/3303753.3303758},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
4,919 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 6.3519157e-05
5,234 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 6.2159562e-05
5,349 The NebulaStream Platform: Data and Application Management for the Internet of Things 2020 CIDR 6.1679453e-05
6,125 Parallel Index-based Stream Join on a Multicore CPU 2020 SIGMOD 5.8761704e-05
6,444 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 5.7807677e-05
7,376 NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications 2025 SIGMOD 5.5381227e-05
7,808 Analyzing Vectorized Hash Tables Across CPU Architectures 2023 VLDB 5.448023e-05
7,968 Parallelizing Intra-Window Join on Multicores: An Experimental Study 2021 SIGMOD 5.4139853e-05
7,980 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 5.4120499e-05
8,019 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 5.4045347e-05
9,189 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB 5.2097224e-05
9,209 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 5.2060149e-05
9,817 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 5.1233734e-05
10,197 LPStream: Fine-grained Lazy Provenance for Stream Processing 2026 SIGMOD 5.0599411e-05
10,273 Darwin: Scale-In Stream Processing 2022 CIDR 5.0468382e-05
10,336 Distributed Stream KNN Join 2021 SIGMOD 5.0309635e-05
10,552 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.9769913e-05
10,577 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.9769913e-05
10,743 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.9769913e-05
10,783 Incremental Stream Query Deployment under Continuous Infrastructure Changes in the Cloud-Edge Continuum 2026 VLDB 4.9769913e-05
11,978 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.9769913e-05
12,072 Rethinking Message Brokers on RDMA and NVM 2020 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
14 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.00064013679
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056835296
25 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00053906051
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030414379
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024589307
218 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024379041
231 Storm @Twitter 2014 SIGMOD 0.00023830094
261 Data-Oriented Transaction Execution 2010 VLDB 0.0002286084
325 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.0002095522
511 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00017058115
594 Linear Road: A Stream Data Management Benchmark 2004 VLDB 0.00015816384
685 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014778299
945 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012933247
970 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00012776109
1,028 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012416417
1,286 Resource Sharing in Continuous Sliding-Window Aggregates 2004 VLDB 0.00011188038
1,383 On-the-Fly Sharing for Streamed Aggregation 2006 SIGMOD 0.00010842596
1,987 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD 9.2478037e-05
2,446 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.4544371e-05
2,601 Robust Query Processing in Co-Processor-accelerated Databases 2016 SIGMOD 8.2325291e-05
2,740 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0682988e-05
3,108 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 7.6392673e-05
3,124 Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database 2015 SIGMOD 7.6222513e-05
4,056 Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement 2015 VLDB 6.8239192e-05
5,017 Massive Scale-out of Expensive Continuous Queries 2011 VLDB 6.3114443e-05
5,771 IBM InfoSphere Streams for Scalable, Real-Time, Intelligent Transportation Services 2010 SIGMOD 5.9969505e-05
7,727 Extending XQuery with Window Functions 2007 VLDB 5.4652337e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 970 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
2 7,980 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD
3 10,577 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD
4 8,426 Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing 2025 SIGMOD
5 10,273 Darwin: Scale-In Stream Processing 2022 CIDR
6 2,694 Executing Stream Joins on the Cell Processor 2007 VLDB
7 8,588 Changing Engines in Midstream: A Java Stream Computational Model for Big Data Processing 2014 VLDB
8 6,543 A Holistic View of Stream Partitioning Costs 2017 VLDB
9 2,446 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD
10 10,552 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD