DBScholar

Back to papers

ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation

Summary: ByteCard trains and deploys cardinality estimators in ByteHouse, replacing Selinger-style estimates for huge-scale queries. Balancing accuracy and practicality (latency, size, training cost), it yields up to 30% lower 99th percentile latency on real data. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h2598fed5194eca4f
Venue
SIGMOD
Year
2024
Pagerank
5.2371313e-05
Overall Rank
9,010 | 39.45%
DOI
10.1145/3626246.3653376

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{han_sigmod24,
        title = {{ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation}},
        author = {Han, Yuxing and Wang, Haoyu and Chen, Lixiang and Dong, Yifeng and Chen, Xing and Yu, Benquan and Yang, Chengcheng and Qian, Weining},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653376},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653376},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 38 of 38 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023943337
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041210636
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036675568
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
178 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026620521
234 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00023756332
295 Towards Estimation Error Guarantees for Distinct Values 2000 PODS 0.00021908194
314 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00021276452
318 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021166957
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019050182
462 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017836105
510 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017059914
681 Amazon Redshift Re-invented 2022 SIGMOD 0.0001482366
691 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014737455
892 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013221727
981 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012713454
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012396854
1,328 Column-oriented Database Systems 2009 VLDB 0.00010998855
2,002 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.2076835e-05
2,483 AnalyticDB: Real-time OLAP Database System at Alibaba Cloud 2019 VLDB 8.3973995e-05
2,518 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3532841e-05
2,583 Fauce: Fast and Accurate Deep Ensembles with Uncertainty for Cardinality Estimation 2021 VLDB 8.2589842e-05
2,721 ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases 2021 SIGMOD 8.0931221e-05
2,771 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 8.0338932e-05
2,833 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9539771e-05
2,844 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9446987e-05
2,879 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 7.9126862e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4233639e-05
3,565 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.200937e-05
3,680 openGauss: An Autonomous Database System 2021 VLDB 7.1016555e-05
3,742 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0564546e-05
3,835 Presto: A Decade of SQL Analytics at Meta 2023 SIGMOD 6.9899256e-05
4,536 One Model to Rule them All: Towards Zero-Shot Learning for Databases 2022 CIDR 6.552998e-05
5,020 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.3096708e-05
6,408 A Unified Transferable Model for ML-Enhanced DBMS 2022 CIDR 5.7921918e-05
7,426 Learning to be a Statistician: Learned Estimator for Number of Distinct Values 2022 VLDB 5.5295692e-05
7,604 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4846038e-05
Previous Page 1 / 1 Next

Semantically Similar Papers