A Holistic View of Stream Partitioning Costs

Summary: Holistic partitioning for pSPEs that accounts for tuple imbalance and aggregation costs in stateful streams. The proposed algorithms beat current approaches by up to an order of magnitude, highlighting cost-aware partitioning for real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11601
Venue: VLDB
Year: 2017
Pagerank: 5.884019e-05
Overall Rank: 6,410 | 56.03%
DOI: 10.14778/3137628.3137631

Incoming Non-self Citations Over Time

Authors

1. Nikos R. Katsipoulakis (University of Pittsburgh)
2. Alexandros Labrinidis (University of Pittsburgh)
3. Panos K. Chrysanthis (University of Pittsburgh)

BibTeX Citation

@article{katsipoulakis_vldb17,
        title = {{A Holistic View of Stream Partitioning Costs}},
        author = {Katsipoulakis, Nikos R. and Labrinidis, Alexandros and Chrysanthis, Panos K.},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {11},
        pages = {1286--1297},
        doi = {10.14778/3137628.3137631},
        url = {https://doi.org/10.14778/3137628.3137631},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,568	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	5.4118703e-05
9,128	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	5.3189314e-05
9,898	ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems	2023	VLDB	5.1997534e-05
11,665	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
26	Models and Issues in Data Stream Systems	2002	PODS	0.00052982574
111	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032990214
127	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030738755
220	Storm @Twitter	2014	SIGMOD	0.00024244587
361	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020138717
612	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001573018
710	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014715033
983	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.0001283214
1,389	Realtime Data Processing at Facebook	2016	SIGMOD	0.00010943767
2,892	Scalable and Adaptive Online Joins	2014	VLDB	7.9852178e-05
3,060	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	7.8062155e-05
3,087	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.7702906e-05
3,321	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.5216049e-05
3,532	Scalable Distributed Stream Join Processing	2015	SIGMOD	7.3369085e-05
8,324	THEMIS: Fairness in Federated Stream Processing under Overload	2016	SIGMOD	5.4539042e-05
12,108	CE-Storm: Confidential Elastic Processing of Data Streams	2015	SIGMOD	5.093636e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,291	Managing Intra-operator Parallelism in Parallel Database Systems	1995	VLDB
2	7,585	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD
3	1,354	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD
4	471	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD
5	2,221	Streaming Graph Partitioning: An Experimental Study	2018	VLDB
6	8,711	Customizable Parallel Execution of Scientific Stream Queries	2005	VLDB
7	3,200	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
8	2,892	Scalable and Adaptive Online Joins	2014	VLDB
9	1,852	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	4,918	Massive Scale-out of Expensive Continuous Queries	2011	VLDB