DBScholar

Back to papers

ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation

Summary: ByteCard trains and deploys cardinality estimators in ByteHouse, replacing Selinger-style estimates for huge-scale queries. Balancing accuracy and practicality (latency, size, training cost), it yields up to 30% lower 99th percentile latency on real data. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h2598fed5194eca4f
Venue
SIGMOD
Year
2024
Pagerank
5.219814e-05
Overall Rank
9,031 | 39.47%
DOI
10.1145/3626246.3653376

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{han_sigmod24,
        title = {{ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation}},
        author = {Han, Yuxing and Wang, Haoyu and Chen, Lixiang and Dong, Yifeng and Chen, Xing and Yu, Benquan and Yang, Chengcheng and Qian, Weining},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653376},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653376},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 38 of 38 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023948467
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061463175
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041439488
74 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00037164008
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035920657
177 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026571747
232 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00023776373
296 Towards Estimation Error Guarantees for Distinct Values 2000 PODS 0.00021874894
309 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.0002143249
320 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021128745
405 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019020138
453 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.0001801482
508 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017108973
651 Amazon Redshift Re-invented 2022 SIGMOD 0.00015126716
690 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014703258
893 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013199466
983 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012677179
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012376627
1,337 Column-oriented Database Systems 2009 VLDB 0.00010968302
2,009 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.1813272e-05
2,474 AnalyticDB: Real-time OLAP Database System at Alibaba Cloud 2019 VLDB 8.3955114e-05
2,523 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3316032e-05
2,572 ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases 2021 SIGMOD 8.2581875e-05
2,584 Fauce: Fast and Accurate Deep Ensembles with Uncertainty for Cardinality Estimation 2021 VLDB 8.2435322e-05
2,619 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 8.1985665e-05
2,780 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 8.0073289e-05
2,828 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9476509e-05
2,852 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9201312e-05
3,269 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.463682e-05
3,328 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.4094448e-05
3,687 openGauss: An Autonomous Database System 2021 VLDB 7.0797286e-05
3,740 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0398782e-05
3,847 Presto: A Decade of SQL Analytics at Meta 2023 SIGMOD 6.9668258e-05
4,549 One Model to Rule them All: Towards Zero-Shot Learning for Databases 2022 CIDR 6.5328866e-05
5,044 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.2888728e-05
6,402 A Unified Transferable Model for ML-Enhanced DBMS 2022 CIDR 5.7800842e-05
7,446 Learning to be a Statistician: Learned Estimator for Number of Distinct Values 2022 VLDB 5.5113049e-05
7,621 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4664683e-05
Previous Page 1 / 1 Next

Semantically Similar Papers