Back to papers
Megaphone: Latency-conscious state migration for distributed streaming dataflows
Summary: Megaphone enables latency-conscious state migration for streaming dataflows by subdividing migrations into configurable granularity to limit spikes. Ahead-of-time prep; unmodified Timely dataflow library with a compatible interface, delivering large latency reductions and modest overhead.
(summarized by gpt-5-nano on Feb 09 2026)
- Paper ID
- 11802
- Venue
- VLDB
- Year
- 2019
- Pagerank
- 6.4995312e-05
- Overall Rank
- 4,044 | 71.87%
- DOI
-
10.14778/3329772.3329777
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 15 of 15 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
| 4,795 |
Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines |
2020 |
SIGMOD |
5.9158043e-05 |
| 4,822 |
Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka |
2021 |
SIGMOD |
5.8959131e-05 |
| 5,286 |
StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance |
2023 |
VLDB |
5.5838392e-05 |
| 6,721 |
Beyond Analytics: The Evolution of Stream Processing Systems |
2020 |
SIGMOD |
4.9492015e-05 |
| 8,441 |
Tackling Hardware/Software co-design from a database perspective |
2020 |
CIDR |
4.5124343e-05 |
| 9,496 |
Scabbard: Single-Node Fault-Tolerant Stream Processing |
2022 |
VLDB |
4.3341665e-05 |
| 9,733 |
ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems |
2023 |
VLDB |
4.2942813e-05 |
| 9,883 |
Towards Resource-adaptive Query Execution in Cloud Native Databases |
2024 |
CIDR |
4.2635782e-05 |
| 10,043 |
Accelerating Stream Processing Engines via Hardware Offloading |
2026 |
SIGMOD |
4.1945683e-05 |
| 10,263 |
APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution |
2026 |
VLDB |
4.1945683e-05 |
| 10,274 |
Incremental Stream Query Deployment under Continuous Infrastructure Changes in the Cloud-Edge Continuum |
2026 |
VLDB |
4.1945683e-05 |
| 10,280 |
Meerkat: Scalable, Network-Aware Failure Recovery for the Internet of Things |
2026 |
VLDB |
4.1945683e-05 |
| 10,336 |
Transactional Cloud Applications Go with the (Data)Flow |
2025 |
CIDR |
4.1945683e-05 |
| 10,509 |
Styx: Transactional Stateful Functions on Streaming Dataflows |
2025 |
SIGMOD |
4.1945683e-05 |
| 11,243 |
Fries: Fast and Consistent Runtime Reconfiguration in Dataflow Systems with Transactional Guarantees |
2023 |
VLDB |
4.1945683e-05 |
Outgoing Citations (Sorted by Pagerank)
Showing 10 of 10 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 314 |
MillWheel: Fault-Tolerant Stream Processing at Internet Scale |
2013 |
VLDB |
0.00028084774 |
| 538 |
The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing |
2015 |
VLDB |
0.00020678804 |
| 892 |
Zephyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms |
2011 |
SIGMOD |
0.00015559876 |
| 1,084 |
Dhalion: Self-Regulating Stream Processing in Heron |
2017 |
VLDB |
0.00014209714 |
| 1,121 |
Albatross: Lightweight Elasticity in Shared Storage Databases for the Cloud using Live Data Migration |
2011 |
VLDB |
0.00013856011 |
| 1,226 |
Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management |
2013 |
SIGMOD |
0.00013180799 |
| 1,548 |
Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark |
2018 |
SIGMOD |
0.00011431383 |
| 2,948 |
Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases |
2015 |
SIGMOD |
7.8341023e-05 |
| 3,550 |
Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems |
2018 |
VLDB |
6.9843512e-05 |
| 3,761 |
Dynamic Plan Migration for Continuous Queries Over Data Streams |
2004 |
SIGMOD |
6.7804871e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 10,043 |
Accelerating Stream Processing Engines via Hardware Offloading |
2026 |
SIGMOD |
4.1945683e-05 |
| 1,226 |
Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management |
2013 |
SIGMOD |
0.00013180799 |
| 6,388 |
Optimizing Data-intensive Systems in Disaggregated Data Centers with TELEPORT |
2022 |
SIGMOD |
5.0851841e-05 |
| 3,761 |
Dynamic Plan Migration for Continuous Queries Over Data Streams |
2004 |
SIGMOD |
6.7804871e-05 |
| 9,803 |
Railgun: managing large streaming windows under MAD requirements |
2021 |
VLDB |
4.2807806e-05 |
| 8,217 |
Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines |
2020 |
SIGMOD |
4.5568298e-05 |
| 8,713 |
Stateful Entities: Object-oriented Cloud Applications as Distributed Dataflows |
2023 |
CIDR |
4.4625215e-05 |
| 9,504 |
Supporting Scalable Analytics with Latency Constraints |
2015 |
VLDB |
4.3341665e-05 |
| 10,509 |
Styx: Transactional Stateful Functions on Streaming Dataflows |
2025 |
SIGMOD |
4.1945683e-05 |
| 4,795 |
Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines |
2020 |
SIGMOD |
5.9158043e-05 |