Database Paper Browser

Back to papers

Analyzing Efficient Stream Processing on Modern Hardware

Summary: Evaluates SPEs on modern hardware, revealing underutilization of multicore CPUs and fast networks in shared-nothing designs. Proposes hardware-aware optimizations—code generation, operator fusion, batch parallelism, and windowing—that yield up to 100x single-node throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11984
Venue
VLDB
Year
2019
Pagerank
6.137834e-05
Overall Rank
4,490 | 68.80%
DOI
10.14778/3303753.3303758

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
5,357 LightSaber: Efficient Window Aggregation on Multi-core Processors 2020 SIGMOD 5.5512343e-05
5,438 The NebulaStream Platform: Data and Application Management for the Internet of Things 2020 CIDR 5.5041764e-05
5,741 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 5.3450701e-05
6,469 Parallel Index-based Stream Join on a Multicore CPU 2020 SIGMOD 5.0448159e-05
6,649 Grizzly: Efficient Stream Processing Through Adaptive Query Compilation 2020 SIGMOD 4.9724735e-05
8,004 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 4.6048388e-05
8,021 Parallelizing Intra-Window Join on Multicores: An Experimental Study 2021 SIGMOD 4.600223e-05
8,078 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 4.5873626e-05
8,476 Analyzing Vectorized Hash Tables Across CPU Architectures 2023 VLDB 4.4972784e-05
9,372 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB 4.3461481e-05
9,476 NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications 2025 SIGMOD 4.3300131e-05
9,497 Scabbard: Single-Node Fault-Tolerant Stream Processing 2022 VLDB 4.3300131e-05
9,800 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 4.2777144e-05
9,925 Darwin: Scale-In Stream Processing 2022 CIDR 4.2503199e-05
9,952 Distributed Stream KNN Join 2021 SIGMOD 4.236537e-05
10,024 LPStream: Fine-grained Lazy Provenance for Stream Processing 2026 SIGMOD 4.1905499e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1905499e-05
10,077 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.1905499e-05
10,263 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.1905499e-05
10,286 Incremental Stream Query Deployment under Continuous Infrastructure Changes in the Cloud-Edge Continuum 2026 VLDB 4.1905499e-05
11,471 Klink: Progress-Aware Scheduling for Streaming Data Systems 2021 SIGMOD 4.1905499e-05
11,570 Rethinking Message Brokers on RDMA and NVM 2020 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
35 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.00076209479
41 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00073944756
59 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.0006445664
191 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00035714897
287 Storm @Twitter 2014 SIGMOD 0.00028917909
314 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00028059664
336 Data-Oriented Transaction Execution 2010 VLDB 0.00027008897
417 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00023734582
536 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020651621
590 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00019552343
601 Linear Road: A Stream Data Management Benchmark 2004 VLDB 0.00019372971
1,097 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014083973
1,226 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00013168869
1,351 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012439556
1,397 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012208385
1,557 Resource Sharing in Continuous Sliding-Window Aggregates 2004 VLDB 0.00011381807
1,791 On-the-Fly Sharing for Streamed Aggregation 2006 SIGMOD 0.0001052731
2,204 Continuous Analytics Over Discontinuous Streams 2010 SIGMOD 9.2986554e-05
2,710 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.2580301e-05
3,307 Robust Query Processing in Co-Processor-accelerated Databases 2016 SIGMOD 7.2391191e-05
3,387 Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database 2015 SIGMOD 7.1505623e-05
3,425 General Incremental Sliding-Window Aggregation 2015 VLDB 7.1042928e-05
3,771 SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures 2016 SIGMOD 6.7738535e-05
4,277 Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement 2015 VLDB 6.2878362e-05
5,044 Massive Scale-out of Expensive Continuous Queries 2011 VLDB 5.7338982e-05
6,075 IBM InfoSphere Streams for Scalable, Real-Time, Intelligent Transportation Services 2010 SIGMOD 5.2210956e-05
7,669 Extending XQuery with Window Functions 2007 VLDB 4.6784108e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
1,226 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00013168869
8,004 Rethinking Stateful Stream Processing with RDMA 2022 SIGMOD 4.6048388e-05
10,077 Enjima: A Resource-Adaptive Stream Processing System 2026 SIGMOD 4.1905499e-05
7,932 Demonstrating PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing 2025 SIGMOD 4.6089395e-05
9,925 Darwin: Scale-In Stream Processing 2022 CIDR 4.2503199e-05
2,768 Executing Stream Joins on the Cell Processor 2007 VLDB 8.1518597e-05
8,295 Changing Engines in Midstream: A Java Stream Computational Model for Big Data Processing 2014 VLDB 4.5392079e-05
6,628 A Holistic View of Stream Partitioning Costs 2017 VLDB 4.9833118e-05
2,710 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD 8.2580301e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1905499e-05