DBScholar

Back to papers

StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance

Summary: StreamOps: standalone cloud-native control plane for scalable management of tens of thousands of streaming jobs at ByteDance. Exposes an extensible detect–diagnose–resolve policy API (auto-scaler, straggler detector, job doctor) to mitigate lag and failures; validated in production. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
13370
Venue
VLDB
Year
2023
Pagerank
6.07598e-05
Overall Rank
5,821 | 60.07%
DOI
10.14778/3611540.3611543

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{mao_vldb23,
        title = {{StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance}},
        author = {Mao, Yancan and Chen, Zhanghao and Zhang, Yifan and Wang, Meng and Fang, Yong and Zhang, Guanghui and Shi, Rui and Ma, Richard T. B.},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3501--3514},
        doi = {10.14778/3611540.3611543},
        url = {https://doi.org/10.14778/3611540.3611543},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030738755
224 MillWheel: Fault-Tolerant Stream Processing at Internet Scale 2013 VLDB 0.00024130894
361 The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing 2015 VLDB 0.00020138717
983 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.0001283214
1,224 Dhalion: Self-Regulating Stream Processing in Heron 2017 VLDB 0.00011596911
1,389 Realtime Data Processing at Facebook 2016 SIGMOD 0.00010943767
3,117 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7382559e-05
3,531 Megaphone: Latency-conscious state migration for distributed streaming dataflows 2019 VLDB 7.337549e-05
4,279 Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines 2020 SIGMOD 6.7865878e-05
4,389 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.7304854e-05
5,206 BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures 2019 SIGMOD 6.3180444e-05
5,756 Clonos: Consistent Causal Recovery for Highly-Available Streaming Dataflows 2021 SIGMOD 6.097233e-05
9,366 MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores 2023 SIGMOD 5.2789847e-05
Previous Page 1 / 1 Next

Semantically Similar Papers