Back to papers
StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance
Summary: StreamOps: standalone cloud-native control plane for scalable management of tens of thousands of streaming jobs at ByteDance. Exposes an extensible detect–diagnose–resolve policy API (auto-scaler, straggler detector, job doctor) to mitigate lag and failures; validated in production.
(summarized by gpt-5-mini on Feb 09 2026)
- Paper ID
- 13183
- Venue
- VLDB
- Year
- 2023
- Pagerank
- 5.5784769e-05
- Overall Rank
- 5,292 | 63.23%
- DOI
-
10.14778/3611540.3611543
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 3 of 3 citing papers.
Outgoing Citations (Sorted by Pagerank)
Showing 14 of 14 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 70 |
Hive - A Warehousing Solution Over a Map-Reduce Framework |
2009 |
VLDB |
0.00059744625 |
| 191 |
The Design of the Borealis Stream Processing Engine |
2005 |
CIDR |
0.00035714897 |
| 314 |
MillWheel: Fault-Tolerant Stream Processing at Internet Scale |
2013 |
VLDB |
0.00028059664 |
| 536 |
The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing |
2015 |
VLDB |
0.00020651621 |
| 1,081 |
Dhalion: Self-Regulating Stream Processing in Heron |
2017 |
VLDB |
0.00014201838 |
| 1,226 |
Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management |
2013 |
SIGMOD |
0.00013168869 |
| 1,616 |
Realtime Data Processing at Facebook |
2016 |
SIGMOD |
0.00011133818 |
| 3,551 |
Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems |
2018 |
VLDB |
6.9776252e-05 |
| 4,051 |
Megaphone: Latency-conscious state migration for distributed streaming dataflows |
2019 |
VLDB |
6.4932782e-05 |
| 4,797 |
Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines |
2020 |
SIGMOD |
5.9101178e-05 |
| 4,824 |
Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka |
2021 |
SIGMOD |
5.8902451e-05 |
| 5,670 |
BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures |
2019 |
SIGMOD |
5.3799054e-05 |
| 5,942 |
Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows |
2021 |
SIGMOD |
5.2591128e-05 |
| 9,374 |
MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores |
2023 |
SIGMOD |
4.3453721e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 9,220 |
Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing |
2019 |
SIGMOD |
4.3670162e-05 |
| 7,491 |
Krypton: Real-time Serving and Analytical SQL Engine at ByteDance |
2023 |
VLDB |
4.7135369e-05 |
| 9,732 |
ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems |
2023 |
VLDB |
4.2901665e-05 |
| 11,081 |
ResLake: Towards Minimum Job Latency and Balanced Resource Utilization in Geo-distributed Job Scheduling |
2024 |
VLDB |
4.1905499e-05 |
| 8,454 |
Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance |
2024 |
VLDB |
4.5022073e-05 |
| 4,161 |
Scalable Distributed Stream Join Processing |
2015 |
SIGMOD |
6.3883784e-05 |
| 1,226 |
Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management |
2013 |
SIGMOD |
0.00013168869 |
| 10,421 |
Oceanus: Enable SLO-Aware Vertical Autoscaling for Cloud-Native Streaming Services in Tencent |
2025 |
SIGMOD |
4.1905499e-05 |
| 3,551 |
Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems |
2018 |
VLDB |
6.9776252e-05 |
| 12,145 |
Building User-defined Runtime Adaptation Routines for Stream Processing Applications |
2012 |
VLDB |
4.1905499e-05 |