DBScholar

Back to papers

Dhalion: Self-Regulating Stream Processing in Heron

Summary: Proposes Dhalion, a self-regulating layer for streaming systems on Heron that autonomously tunes knobs to meet throughput SLOs under variable load. Policy-driven reconfiguration scales resources and topology to sustain QoS, with cloud evaluation and open-source policy plans. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h8e37ccdc07b7f69c
Venue
VLDB
Year
2017
Pagerank
0.00011405873
Overall Rank
1,233 | 91.72%
DOI
10.14778/3137765.3137785

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{floratou_vldb17,
        title = {{Dhalion: Self-Regulating Stream Processing in Heron}},
        author = {Floratou, Avrilia and Agrawal, Ashvin and Graham, Bill and Rao, Sriram and Ramasamy, Karthik},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {12},
        pages = {1825--1836},
        doi = {10.14778/3137765.3137785},
        url = {https://doi.org/10.14778/3137765.3137785},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,994 Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless 2022 VLDB 9.2176321e-05
3,033 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7337998e-05
3,398 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 7.3353479e-05
3,683 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.1006425e-05
4,109 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.8008755e-05
4,450 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.594912e-05
4,613 Efficient Placement of Decomposable Aggregation Functions for Stream Processing over Large Geo-Distributed Topologies 2024 VLDB 6.5016725e-05
5,939 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB 5.9407099e-05
6,266 Beyond Analytics: The Evolution of Stream Processing Systems 2020 SIGMOD 5.8303329e-05
6,901 Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation 2021 VLDB 5.6520335e-05
7,410 POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance 2024 VLDB 5.5342768e-05
7,806 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4500623e-05
8,352 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.3488341e-05
8,404 Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines 2020 SIGMOD 5.3385814e-05
9,471 Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing 2019 SIGMOD 5.1711628e-05
9,813 Dhalion in Action: Automatic Management of Streaming Applications 2018 VLDB 5.1257999e-05
9,959 Lorentz: Learned SKU Recommendation Using Profile Data (DMDS) 2024 SIGMOD 5.1038322e-05
10,084 ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems 2023 VLDB 5.0830849e-05
10,541 Accelerating Stream Processing Engines via Hardware Offloading 2026 SIGMOD 4.9793485e-05
10,729 Scarf: Self-Adaptive Tuning via Multi-Objective Reinforcement Learning for Apache Flink 2026 VLDB 4.9793485e-05
10,733 APEROL: Adaptive Parallel Edge-to-cloud Runtime Optimization for Layered Workflow Execution 2026 VLDB 4.9793485e-05
10,846 Meerkat: Scalable, Network-Aware Failure Recovery for the Internet of Things 2026 VLDB 4.9793485e-05
11,199 Styx: Transactional Stateful Functions on Streaming Dataflows 2025 SIGMOD 4.9793485e-05
11,210 Scalable Complex Event Processing on Video Streams 2025 SIGMOD 4.9793485e-05
11,559 Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service 2024 VLDB 4.9793485e-05
12,190 Minimizing Cost by Reducing Scaling Operations in Distributed Stream Processing 2019 VLDB 4.9793485e-05
12,232 Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams 2018 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030427614
218 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024390324
224 Self-Driving Database Management Systems 2017 CIDR 0.00024013745
231 Storm @Twitter 2014 SIGMOD 0.00023841089
606 Twitter Heron: Stream Processing at Scale 2015 SIGMOD 0.00015635133
892 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013227162
940 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00012964445
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 231 Storm @Twitter 2014 SIGMOD
2 9,633 Shrink - Prescribing Resiliency Solutions for Streaming 2017 VLDB
3 7,315 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB
4 3,033 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB
5 11,129 Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent 2025 SIGMOD
6 10,158 Railgun: managing large streaming windows under MAD requirements 2021 VLDB
7 5,939 StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance 2023 VLDB
8 9,200 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB
9 606 Twitter Heron: Stream Processing at Scale 2015 SIGMOD
10 9,813 Dhalion in Action: Automatic Management of Streaming Applications 2018 VLDB