A Holistic View of Stream Partitioning Costs

Summary: Holistic partitioning for pSPEs that accounts for tuple imbalance and aggregation costs in stateful streams. The proposed algorithms beat current approaches by up to an order of magnitude, highlighting cost-aware partitioning for real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11413
Venue: VLDB
Year: 2017
Pagerank: 4.9880986e-05
Overall Rank: 6,629 | 53.89%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,596	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	4.4887993e-05
9,733	ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems	2023	VLDB	4.2942813e-05
9,797	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	4.2818172e-05
11,468	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
43	Models and Issues in Data Stream Systems	2002	PODS	0.00072723062
142	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00041725802
191	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00035738595
288	Storm @Twitter	2014	SIGMOD	0.00028939871
538	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020678804
824	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001623129
1,098	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014114442
1,226	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00013180799
1,613	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011140777
3,382	Scalable and Adaptive Online Joins	2014	VLDB	7.1597145e-05
3,704	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	6.827494e-05
3,761	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	6.7804871e-05
3,762	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	6.7804471e-05
4,167	Scalable Distributed Stream Join Processing	2015	SIGMOD	6.3919506e-05
8,337	THEMIS: Fairness in Federated Stream Processing under Overload	2016	SIGMOD	4.5434623e-05
11,909	CE-Storm: Confidential Elastic Processing of Data Streams	2015	SIGMOD	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,354	Managing Intra-operator Parallelism in Parallel Database Systems	1995	VLDB	0.00012408166
7,715	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD	4.6699261e-05
1,788	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD	0.00010555742
679	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD	0.00018215154
2,494	Streaming Graph Partitioning: An Experimental Study	2018	VLDB	8.6508229e-05
8,498	Customizable Parallel Execution of Scientific Stream Queries	2005	VLDB	4.4981372e-05
3,821	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	6.7281515e-05
3,382	Scalable and Adaptive Online Joins	2014	VLDB	7.1597145e-05
2,413	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	8.8672223e-05
5,045	Massive Scale-out of Expensive Continuous Queries	2011	VLDB	5.740793e-05