DBScholar

Back to papers

StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance

Summary: StreamOps: standalone cloud-native control plane for scalable management of tens of thousands of streaming jobs at ByteDance. Exposes an extensible detect–diagnose–resolve policy API (auto-scaler, straggler detector, job doctor) to mitigate lag and failures; validated in production. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h061da67da7981429
Venue
VLDB
Year
2023
Pagerank
5.9182633e-05
Overall Rank
5,952 | 60.11%
DOI
10.14778/3611540.3611543
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{mao_vldb23,
        title = {{StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance}},
        author = {Mao, Yancan and Chen, Zhanghao and Zhang, Yifan and Wang, Meng and Fang, Yong and Zhang, Guanghui and Shi, Rui and Ma, Richard T. B.},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3501--3514},
        doi = {10.14778/3611540.3611543},
        url = {https://doi.org/10.14778/3611540.3611543},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
128 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030317705
219 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.0002429959
328 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020889528
973 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.00012734154
1,244 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00011363001
1,310 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011065568
3,043 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7045781e-05
3,409 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 7.3076317e-05
4,129 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.7751787e-05
4,475 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.5699934e-05
4,889 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.3513193e-05
5,347 BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures 2019 SIGMOD 6.1566135e-05
9,486 MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores 2023 SIGMOD 5.1562396e-05
Previous Page 1 / 1 Next

Semantically Similar Papers