DBScholar

Back to papers

Analyzing Efficient Stream Processing on Modern Hardware

Summary: Evaluates SPEs on modern hardware, revealing underutilization of multicore CPUs and fast networks in shared-nothing designs. Proposes hardware-aware optimizations—code generation, operator fusion, batch parallelism, and windowing—that yield up to 100x single-node throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h48996f8509cfd077
Venue
VLDB
Year
2019
Pagerank
6.8967981e-05
Overall Rank
3,939 | 73.60%
DOI
10.14778/3303753.3303758
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zeuch_vldb19,
        title = {{Analyzing Efficient Stream Processing on Modern Hardware}},
        author = {Zeuch, Steffen and Del Monte, Bonaventura and Karimov, Jeyhun and Lutz, Clemens and Renz, Manuel and Traub, Jonas and Breß, Sebastian and Rabl, Tilmann and Markl, Volker},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {5},
        pages = {516--530},
        doi = {10.14778/3303753.3303758},
        url = {https://doi.org/10.14778/3303753.3303758},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
4,942 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 6.3309707e-05
5,246 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 6.1985833e-05
5,363 The NebulaStream Platform: Data and Application Management for the Internet of Things 2020 CIDR 6.1475521e-05
6,139 Parallel Index-based Stream Join on a Multicore CPU 2020 SIGMOD 5.8567401e-05
6,456 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 5.7616575e-05
7,395 NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications 2025 SIGMOD 5.5198102e-05
7,822 Analyzing Vectorized Hash Tables Across CPU Architectures 2023 VLDB 5.4304761e-05
7,985 Parallelizing Intra-Window Join on Multicores: An Experimental Study 2021 SIGMOD 5.3960833e-05
7,996 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 5.3941543e-05
8,035 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 5.3866645e-05
9,213 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB 5.1926696e-05
9,232 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 5.1888006e-05
9,851 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 5.1064323e-05
10,230 LPStream: Fine-grained Lazy Provenance for Stream Processing 2026 SIGMOD 5.0432098e-05
10,300 Darwin: Scale-In Stream Processing 2022 CIDR 5.0301502e-05
10,362 Distributed Stream KNN Join 2021 SIGMOD 5.014328e-05
10,617 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.9605343e-05
10,640 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.9605343e-05
10,804 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.9605343e-05
10,844 Incremental Stream Query Deployment under Continuous Infrastructure Changes in the Cloud-Edge Continuum 2026 VLDB 4.9605343e-05
12,022 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.9605343e-05
12,116 Rethinking Message Brokers on RDMA and NVM 2020 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
14 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.00063972112
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056737487
25 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00053734242
128 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030317705
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024554257
219 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.0002429959
233 Storm @Twitter 2014 SIGMOD 0.00023754096
262 Data-Oriented Transaction Execution 2010 VLDB 0.00022832269
328 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020889528
514 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00017005839
596 Linear Road: A Stream Data Management Benchmark 2004 VLDB 0.00015766455
688 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014736145
928 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00013012601
973 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00012734154
1,025 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012396134
1,290 Resource Sharing in Continuous Sliding-Window Aggregates 2004 VLDB 0.00011151196
1,388 On-the-Fly Sharing for Streamed Aggregation 2006 SIGMOD 0.00010806922
1,997 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD 9.217553e-05
2,453 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.426611e-05
2,606 Robust Query Processing in Co-Processor-accelerated Databases 2016 SIGMOD 8.2118469e-05
2,751 General Incremental Sliding-Window Aggregation 2015 VLDB 8.0416632e-05
3,117 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 7.6142606e-05
3,127 Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database 2015 SIGMOD 7.6047902e-05
4,036 Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement 2015 VLDB 6.8259759e-05
5,039 Massive Scale-out of Expensive Continuous Queries 2011 VLDB 6.2905904e-05
5,786 IBM InfoSphere Streams for Scalable, Real-Time, Intelligent Transportation Services 2010 SIGMOD 5.9771448e-05
7,740 Extending XQuery with Window Functions 2007 VLDB 5.447163e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 973 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD
2 7,996 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD
3 10,640 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD
4 8,442 Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing 2025 SIGMOD
5 10,300 Darwin: Scale-In Stream Processing 2022 CIDR
6 2,704 Executing Stream Joins on the Cell Processor 2007 VLDB
7 8,605 Changing Engines in Midstream: A Java Stream Computational Model for Big Data Processing 2014 VLDB
8 6,553 A Holistic View of Stream Partitioning Costs 2017 VLDB
9 2,453 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD
10 10,617 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD