Database Paper Browser

Back to papers

Dhalion: Self-Regulating Stream Processing in Heron

Summary: Proposes Dhalion, a self-regulating layer for streaming systems on Heron that autonomously tunes knobs to meet throughput SLOs under variable load. Policy-driven reconfiguration scales resources and topology to sustain QoS, with cloud evaluation and open-source policy plans. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11464
Venue
VLDB
Year
2017
Pagerank
0.00014209714
Overall Rank
1,084 | 92.47%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
2,375 Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless 2022 VLDB 8.9452359e-05
3,458 Efficient Placement of Decomposable Aggregation Functions for Stream Processing over Large Geo-Distributed Topologies 2024 VLDB 7.0748084e-05
3,550 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 6.9843512e-05
3,875 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 6.675257e-05
4,044 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 6.4995312e-05
4,795 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 5.9158043e-05
4,822 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 5.8959131e-05
5,286 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB 5.5838392e-05
6,721 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 4.9492015e-05
7,047 Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation 2021 VLDB 4.8521181e-05
7,655 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 4.6872456e-05
8,217 Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines 2020 SIGMOD 4.5568298e-05
8,416 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 4.5196199e-05
9,187 POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance 2024 VLDB 4.3780059e-05
9,217 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 4.3712054e-05
9,501 Dhalion in Action: Automatic Management of Streaming Applications 2018 VLDB 4.3341665e-05
9,733 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 4.2942813e-05
10,043 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.1945683e-05
10,259 Scarf: Self-Adaptive Tuning via Multi-Objective Reinforcement Learning for Apache Flink 2026 VLDB 4.1945683e-05
10,263 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.1945683e-05
10,280 Meerkat: Scalable, Network-Aware Failure Recovery for the Internet of Things 2026 VLDB 4.1945683e-05
10,509 Styx: Transactional Stateful Functions on Streaming Dataflows 2025 SIGMOD 4.1945683e-05
10,523 Scalable Complex Event Processing on Video Streams 2025 SIGMOD 4.1945683e-05
10,966 Lorentz: Learned SKU Recommendation Using Profile Data (DMDS) 2024 SIGMOD 4.1945683e-05
11,011 Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service 2024 VLDB 4.1945683e-05
11,695 Minimizing Cost by Reducing Scaling Operations in Distributed Stream Processing 2019 VLDB 4.1945683e-05
11,728 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
191 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00035738595
288 Storm @Twitter 2014 SIGMOD 0.00028939871
314 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00028084774
359 Self-Driving Database Management Systems 2017 CIDR 0.0002592783
824 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.0001623129
953 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00015095431
1,071 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00014312777
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
288 Storm @Twitter 2014 SIGMOD 0.00028939871
9,302 Shrink – Prescribing Resiliency Solutions for Streaming 2017 VLDB 4.3587156e-05
7,372 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB 4.7496881e-05
3,550 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 6.9843512e-05
10,410 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD 4.1945683e-05
9,803 Railgun: managing large streaming windows under MAD requirements 2021 VLDB 4.2807806e-05
5,286 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB 5.5838392e-05
9,797 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 4.2818172e-05
824 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.0001623129
9,501 Dhalion in Action: Automatic Management of Streaming Applications 2018 VLDB 4.3341665e-05