DBScholar

Back to papers

ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation

Summary: ByteCard trains and deploys cardinality estimators in ByteHouse, replacing Selinger-style estimates for huge-scale queries. Balancing accuracy and practicality (latency, size, training cost), it yields up to 30% lower 99th percentile latency on real data. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h2598fed5194eca4f
Venue
SIGMOD
Year
2024
Pagerank
5.2375369e-05
Overall Rank
9,012 | 39.41%
DOI
10.1145/3626246.3653376

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{han_sigmod24,
        title = {{ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation}},
        author = {Han, Yuxing and Wang, Haoyu and Chen, Lixiang and Dong, Yifeng and Chen, Xing and Yu, Benquan and Yang, Chengcheng and Qian, Weining},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653376},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653376},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 38 of 38 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023947656
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041219077
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036684414
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035864347
179 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026611886
234 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00023765806
295 Towards Estimation Error Guarantees for Distinct Values 2000 PODS 0.00021914399
314 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00021282642
318 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021167555
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019045544
461 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017829982
512 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017050173
680 Amazon Redshift Re-invented 2022 SIGMOD 0.00014828697
692 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014741011
892 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013227162
982 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012714044
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012401489
1,327 Column-oriented Database Systems 2009 VLDB 0.00011003776
2,004 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.2065719e-05
2,484 AnalyticDB: Real-time OLAP Database System at Alibaba Cloud 2019 VLDB 8.3993882e-05
2,522 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3477168e-05
2,583 Fauce: Fast and Accurate Deep Ensembles with Uncertainty for Cardinality Estimation 2021 VLDB 8.2589758e-05
2,720 ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases 2021 SIGMOD 8.0966919e-05
2,770 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 8.037607e-05
2,834 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9560627e-05
2,846 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9453616e-05
2,885 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 7.9094988e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4207879e-05
3,563 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.2042148e-05
3,682 openGauss: An Autonomous Database System 2021 VLDB 7.1013922e-05
3,741 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0594076e-05
3,835 Presto: A Decade of SQL Analytics at Meta 2023 SIGMOD 6.9931698e-05
4,538 One Model to Rule them All: Towards Zero-Shot Learning for Databases 2022 CIDR 6.553705e-05
5,022 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.3100988e-05
6,416 A Unified Transferable Model for ML-Enhanced DBMS 2022 CIDR 5.7920805e-05
7,429 Learning to be a Statistician: Learned Estimator for Number of Distinct Values 2022 VLDB 5.5300853e-05
7,598 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4871733e-05
Previous Page 1 / 1 Next

Semantically Similar Papers