A Holistic View of Stream Partitioning Costs

Summary: Holistic partitioning for pSPEs that accounts for tuple imbalance and aggregation costs in stateful streams. The proposed algorithms beat current approaches by up to an order of magnitude, highlighting cost-aware partitioning for real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc7eba5a1ccdd0ae8
Venue: VLDB
Year: 2017
Pagerank: 5.7306258e-05
Overall Rank: 6,553 | 56.08%
DOI: 10.14778/3137628.3137631
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Nikos R. Katsipoulakis (University of Pittsburgh)
2. Alexandros Labrinidis (University of Pittsburgh)
3. Panos K. Chrysanthis (University of Pittsburgh)

BibTeX Citation

@article{katsipoulakis_vldb17,
        title = {{A Holistic View of Stream Partitioning Costs}},
        author = {Katsipoulakis, Nikos R. and Labrinidis, Alexandros and Chrysanthis, Panos K.},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {11},
        pages = {1286--1297},
        doi = {10.14778/3137628.3137631},
        url = {https://doi.org/10.14778/3137628.3137631},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,705	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	5.2707935e-05
9,232	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	5.1888006e-05
10,123	ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems	2023	VLDB	5.0638787e-05
12,022	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
26	Models and Issues in Data Stream Systems	2002	PODS	0.00051942573
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032341214
128	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030317705
233	Storm @Twitter	2014	SIGMOD	0.00023754096
328	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020889528
607	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015577054
688	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014736145
973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012734154
1,310	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011065568
2,972	Scalable and Adaptive Online Joins	2014	VLDB	7.7844791e-05
3,117	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	7.6142606e-05
3,138	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.5866991e-05
3,380	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.3415892e-05
3,610	Scalable Distributed Stream Join Processing	2015	SIGMOD	7.1463915e-05
8,514	THEMIS: Fairness in Federated Stream Processing under Overload	2016	SIGMOD	5.311399e-05
12,450	CE-Storm: Confidential Elastic Processing of Data Streams	2015	SIGMOD	4.9605343e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,274	Managing Intra-operator Parallelism in Parallel Database Systems	1995	VLDB
2	7,725	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD
3	1,388	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD
4	474	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD
5	2,253	Streaming Graph Partitioning: An Experimental Study	2018	VLDB
6	8,906	Customizable Parallel Execution of Scientific Stream Queries	2005	VLDB
7	3,258	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
8	2,972	Scalable and Adaptive Online Joins	2014	VLDB
9	1,892	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	5,039	Massive Scale-out of Expensive Continuous Queries	2011	VLDB