Database Paper Browser

Back to papers

Analyzing Efficient Stream Processing on Modern Hardware

Summary: Evaluates SPEs on modern hardware, revealing underutilization of multicore CPUs and fast networks in shared-nothing designs. Proposes hardware-aware optimizations—code generation, operator fusion, batch parallelism, and windowing—that yield up to 100x single-node throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11983
Venue
VLDB
Year
2019
Pagerank
6.145117e-05
Overall Rank
4,488 | 68.78%
DOI
10.14778/3303753.3303758

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
5,193 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 5.6371049e-05
5,427 The NebulaStream Platform: Data and Application Management for the Internet of Things 2020 CIDR 5.509468e-05
5,731 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 5.3502065e-05
6,476 Parallel Index-based Stream Join on a Multicore CPU 2020 SIGMOD 5.0496617e-05
6,648 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 4.9771723e-05
8,001 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 4.6092573e-05
8,018 Parallelizing Intra-Window Join on Multicores: An Experimental Study 2021 SIGMOD 4.6046381e-05
8,075 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 4.5917655e-05
8,478 Analyzing Vectorized Hash Tables Across CPU Architectures 2023 VLDB 4.5015937e-05
9,364 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB 4.3502487e-05
9,474 NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications 2025 SIGMOD 4.3341665e-05
9,496 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 4.3341665e-05
9,797 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 4.2818172e-05
9,926 Darwin: Scale-In Stream Processing 2022 CIDR 4.2543961e-05
9,953 Distributed Stream KNN Join 2021 SIGMOD 4.2405999e-05
10,024 LPStream: Fine-grained Lazy Provenance for Stream Processing 2026 SIGMOD 4.1945683e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1945683e-05
10,077 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.1945683e-05
10,263 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.1945683e-05
10,274 Incremental Stream Query Deployment under Continuous Infrastructure Changes in the Cloud-Edge Continuum 2026 VLDB 4.1945683e-05
11,468 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.1945683e-05
11,566 Rethinking Message Brokers on RDMA and NVM 2020 SIGMOD 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
35 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.00076197749
41 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00073964959
60 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00064439773
191 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00035738595
288 Storm @Twitter 2014 SIGMOD 0.00028939871
314 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00028084774
338 Data-Oriented Transaction Execution 2010 VLDB 0.00026973858
418 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00023729211
538 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020678804
591 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00019569071
600 Linear Road: A Stream Data Management Benchmark 2004 VLDB 0.0001938744
1,098 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014114442
1,226 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00013180799
1,361 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012379741
1,409 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012132768
1,554 Resource Sharing in Continuous Sliding-Window Aggregates 2004 VLDB 0.00011400581
1,788 On-the-Fly Sharing for Streamed Aggregation 2006 SIGMOD 0.00010555742
2,198 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD 9.308495e-05
2,706 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.2673299e-05
3,305 Robust Query Processing in Co-Processor-accelerated Databases 2016 SIGMOD 7.2460965e-05
3,378 General Incremental Sliding-Window Aggregation 2015 VLDB 7.1622572e-05
3,388 Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database 2015 SIGMOD 7.1571148e-05
3,762 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 6.7804471e-05
4,282 Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement 2015 VLDB 6.293052e-05
5,045 Massive Scale-out of Expensive Continuous Queries 2011 VLDB 5.740793e-05
6,071 IBM InfoSphere Streams for Scalable, Real-Time, Intelligent Transportation Services 2010 SIGMOD 5.2261393e-05
7,670 Extending XQuery with Window Functions 2007 VLDB 4.682982e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
1,226 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00013180799
8,001 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 4.6092573e-05
10,077 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.1945683e-05
7,930 Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing 2025 SIGMOD 4.613363e-05
9,926 Darwin: Scale-In Stream Processing 2022 CIDR 4.2543961e-05
2,763 Executing Stream Joins on the Cell Processor 2007 VLDB 8.1579306e-05
8,301 Changing Engines in Midstream: A Java Stream Computational Model for Big Data Processing 2014 VLDB 4.5435639e-05
6,629 A Holistic View of Stream Partitioning Costs 2017 VLDB 4.9880986e-05
2,706 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.2673299e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1945683e-05