Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems
Summary: Prompt introduces dynamic data partitioning for micro-batch streams, with buffering and key-sorting to handle skew. Greedy workload-aware partitioning with load-aware distribution and elastic resources yields 2x throughput with maintained latency. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Ahmed S. Abdelhamid (Purdue University)
- 2. Ahmed R. Mahmood (Purdue University)
- 3. Anas Daghistani (Purdue University)
- 4. Walid G. Aref (Purdue University)
BibTeX Citation
@inproceedings{abdelhamid_sigmod20,
title = {{Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems}},
author = {Abdelhamid, Ahmed S. and Mahmood, Ahmed R. and Daghistani, Anas and Aref, Walid G.},
series = {{SIGMOD} '20},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3318464.3389713},
url = {https://dl.acm.org/doi/10.1145/3318464.3389713},
year = {2020}
}Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 8,310 | TreeSensing: Linearly Compressing Sketches with Flexibility | 2023 | SIGMOD | 5.4556836e-05 |
| 9,128 | Dalton: Learned Partitioning for Distributed Data Streams | 2023 | VLDB | 5.3189314e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 361 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB | 0.00020138717 |
| 1,044 | Fine-grained Partitioning for Aggressive Data Skipping | 2014 | SIGMOD | 0.0001244236 |
| 1,190 | Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark | 2018 | SIGMOD | 0.00011743246 |
| 2,393 | Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core | 2006 | SIGMOD | 8.6366772e-05 |
| 4,918 | Massive Scale-out of Expensive Continuous Queries | 2011 | VLDB | 6.4469122e-05 |
| 6,410 | A Holistic View of Stream Partitioning Costs | 2017 | VLDB | 5.884019e-05 |
| 12,141 | A Demonstration of AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data | 2015 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 9,128 | Dalton: Learned Partitioning for Distributed Data Streams | 2023 | VLDB |
| 2 | 2,513 | Tuple Routing Strategies for Distributed Eddies | 2003 | VLDB |
| 3 | 12,191 | A Partitioning Framework for Aggressive Data Skipping | 2014 | VLDB |
| 4 | 9,336 | Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing | 2019 | SIGMOD |
| 5 | 722 | Adaptive Filters for Continuous Queries over Distributed Data Streams | 2003 | SIGMOD |
| 6 | 11,181 | Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model | 2024 | SIGMOD |
| 7 | 9,460 | Providing Resiliency to Load Variations in Distributed Stream Processing | 2006 | VLDB |
| 8 | 2,178 | Optimal Sampling From Distributed Streams | 2010 | PODS |
| 9 | 6,410 | A Holistic View of Stream Partitioning Costs | 2017 | VLDB |
| 10 | 9,640 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB |