A Holistic View of Stream Partitioning Costs

Summary: Holistic partitioning for pSPEs that accounts for tuple imbalance and aggregation costs in stateful streams. The proposed algorithms beat current approaches by up to an order of magnitude, highlighting cost-aware partitioning for real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11414
Venue: VLDB
Year: 2017
Pagerank: 4.9833118e-05
Overall Rank: 6,628 | 53.94%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,594	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	4.4844961e-05
9,732	ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems	2023	VLDB	4.2901665e-05
9,800	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	4.2777144e-05
11,471	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
43	Models and Issues in Data Stream Systems	2002	PODS	0.00072660894
143	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00041688468
191	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00035714897
287	Storm @Twitter	2014	SIGMOD	0.00028917909
536	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020651621
822	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00016226851
1,097	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014083973
1,226	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00013168869
1,616	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011133818
3,384	Scalable and Adaptive Online Joins	2014	VLDB	7.153329e-05
3,703	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	6.8249334e-05
3,770	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	6.7743365e-05
3,771	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	6.7738535e-05
4,161	Scalable Distributed Stream Join Processing	2015	SIGMOD	6.3883784e-05
8,330	THEMIS: Fairness in Federated Stream Processing under Overload	2016	SIGMOD	4.5391049e-05
11,917	CE-Storm: Confidential Elastic Processing of Data Streams	2015	SIGMOD	4.1905499e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,358	Managing Intra-operator Parallelism in Parallel Database Systems	1995	VLDB	0.00012402333
7,713	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD	4.6662571e-05
1,791	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD	0.0001052731
679	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD	0.00018211621
2,497	Streaming Graph Partitioning: An Experimental Study	2018	VLDB	8.6427191e-05
8,496	Customizable Parallel Execution of Scientific Stream Queries	2005	VLDB	4.4938165e-05
3,825	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	6.7225803e-05
3,384	Scalable and Adaptive Online Joins	2014	VLDB	7.153329e-05
2,410	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	8.8643562e-05
5,044	Massive Scale-out of Expensive Continuous Queries	2011	VLDB	5.7338982e-05