Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems
Summary: Prompt introduces dynamic data partitioning for micro-batch streams, with buffering and key-sorting to handle skew. Greedy workload-aware partitioning with load-aware distribution and elastic resources yields 2x throughput with maintained latency. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,041 | TreeSensing: Linearly Compressing Sketches with Flexibility | 2023 | SIGMOD | 4.3997447e-05 |
| 9,800 | Dalton: Learned Partitioning for Distributed Data Streams | 2023 | VLDB | 4.2777144e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 536 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB | 0.00020651621 |
| 1,473 | Fine-grained Partitioning for Aggressive Data Skipping | 2014 | SIGMOD | 0.00011786148 |
| 1,546 | Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark | 2018 | SIGMOD | 0.00011418993 |
| 2,710 | Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core | 2006 | SIGMOD | 8.2580301e-05 |
| 5,044 | Massive Scale-out of Expensive Continuous Queries | 2011 | VLDB | 5.7338982e-05 |
| 6,628 | A Holistic View of Stream Partitioning Costs | 2017 | VLDB | 4.9833118e-05 |
| 11,951 | A Demonstration of AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data | 2015 | VLDB | 4.1905499e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| Overall Rank | Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,800 | Dalton: Learned Partitioning for Distributed Data Streams | 2023 | VLDB | 4.2777144e-05 |
| 2,818 | Tuple Routing Strategies for Distributed Eddies | 2003 | VLDB | 8.0673424e-05 |
| 12,001 | A Partitioning Framework for Aggressive Data Skipping | 2014 | VLDB | 4.1905499e-05 |
| 9,220 | Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing | 2019 | SIGMOD | 4.3670162e-05 |
| 1,006 | Adaptive Filters for Continuous Queries over Distributed Data Streams | 2003 | SIGMOD | 0.00014684829 |
| 10,970 | Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model | 2024 | SIGMOD | 4.1905499e-05 |
| 9,318 | Providing Resiliency to Load Variations in Distributed Stream Processing | 2006 | VLDB | 4.3523601e-05 |
| 2,068 | Optimal Sampling From Distributed Streams | 2010 | PODS | 9.638573e-05 |
| 6,628 | A Holistic View of Stream Partitioning Costs | 2017 | VLDB | 4.9833118e-05 |
| 9,505 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB | 4.3300131e-05 |