A Holistic View of Stream Partitioning Costs

Summary: Holistic partitioning for pSPEs that accounts for tuple imbalance and aggregation costs in stateful streams. The proposed algorithms beat current approaches by up to an order of magnitude, highlighting cost-aware partitioning for real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc7eba5a1ccdd0ae8
Venue: VLDB
Year: 2017
Pagerank: 5.7523608e-05
Overall Rank: 6,541 | 56.03%
DOI: 10.14778/3137628.3137631

Incoming Non-self Citations Over Time

Authors

1. Nikos R. Katsipoulakis (University of Pittsburgh)
2. Alexandros Labrinidis (University of Pittsburgh)
3. Panos K. Chrysanthis (University of Pittsburgh)

BibTeX Citation

@article{katsipoulakis_vldb17,
        title = {{A Holistic View of Stream Partitioning Costs}},
        author = {Katsipoulakis, Nikos R. and Labrinidis, Alexandros and Chrysanthis, Panos K.},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {11},
        pages = {1286--1297},
        doi = {10.14778/3137628.3137631},
        url = {https://doi.org/10.14778/3137628.3137631},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,678	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	5.2907845e-05
9,200	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	5.2084806e-05
10,084	ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems	2023	VLDB	5.0830849e-05
11,972	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
26	Models and Issues in Data Stream Systems	2002	PODS	0.00052121228
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032459277
127	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030427614
231	Storm @Twitter	2014	SIGMOD	0.00023841089
325	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020964941
606	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015635133
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014782777
968	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012782051
1,303	Realtime Data Processing at Facebook	2016	SIGMOD	0.0001110427
2,953	Scalable and Adaptive Online Joins	2014	VLDB	7.8137255e-05
3,106	SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures	2016	SIGMOD	7.6428848e-05
3,128	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.6151967e-05
3,371	Dynamic Plan Migration for Continuous Queries Over Data Streams	2004	SIGMOD	7.3693585e-05
3,603	Scalable Distributed Stream Join Processing	2015	SIGMOD	7.173496e-05
8,490	THEMIS: Fairness in Federated Stream Processing under Overload	2016	SIGMOD	5.3315439e-05
12,401	CE-Storm: Confidential Elastic Processing of Data Streams	2015	SIGMOD	4.9793485e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,271	Managing Intra-operator Parallelism in Parallel Database Systems	1995	VLDB
2	7,706	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD
3	1,383	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD
4	472	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD
5	2,248	Streaming Graph Partitioning: An Experimental Study	2018	VLDB
6	8,876	Customizable Parallel Execution of Scientific Stream Queries	2005	VLDB
7	3,239	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
8	2,953	Scalable and Adaptive Online Joins	2014	VLDB
9	1,883	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	5,013	Massive Scale-out of Expensive Continuous Queries	2011	VLDB