DBScholar

Back to papers

A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation

Summary: Unified deep autoregressive UAE combines data and query signals to learn distributions for cardinality estimation. Progressive sampling via Gumbel-Softmax enables query learning; UAE yields tail error in single digits and higher accuracy with efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h82c92734a94745ed
Venue
SIGMOD
Year
2021
Pagerank
7.7041081e-05
Overall Rank
3,053 | 79.49%
DOI
10.1145/3448016.3452830

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{wu_sigmod21,
        title = {{A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation}},
        author = {Wu, Peizhi and Cong, Gao},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3452830},
        url = {https://dl.acm.org/doi/10.1145/3448016.3452830},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 35 of 35 citing papers.

Rank Citing Paper Year Venue Pagerank
981 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012713454
2,342 Learned Cardinality Estimation: An In-depth Study 2022 SIGMOD 8.6074783e-05
2,635 Neural Subgraph Counting with Wasserstein Estimator 2022 SIGMOD 8.1954989e-05
2,844 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9446987e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4233639e-05
4,299 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.6766173e-05
4,743 Machine Learning for Databases 2021 VLDB 6.4379536e-05
4,945 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.3418058e-05
5,062 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.2896995e-05
5,211 SAM: Database Generation from Query Workloads with Supervised Autoregressive Models 2022 SIGMOD 6.2232582e-05
5,224 SafeBound: A Practical System for Generating Cardinality Bounds 2023 SIGMOD 6.2197808e-05
5,850 Modeling Shifting Workloads for Learned Database Systems 2024 SIGMOD 5.9697921e-05
6,664 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.715134e-05
6,796 dbET: Execution Time Distribution-based Plan Selection 2023 SIGMOD 5.6784895e-05
6,824 ASM: Harmonizing Autoregressive Model, Sampling, and Multi-dimensional Statistics Merging for Cardinality Estimation 2024 SIGMOD 5.670071e-05
7,356 PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost! 2021 VLDB 5.5421826e-05
8,009 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning 2024 VLDB 5.4063491e-05
8,638 LIMAO: A Framework for Lifelong Modular Learned Query Optimization 2025 VLDB 5.2965922e-05
8,667 ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation 2023 VLDB 5.2905894e-05
8,888 Spatial Query Optimization With Learning 2024 VLDB 5.2543468e-05
9,219 NeuroSketch: Fast and Approximate Evaluation of Range Aggregate Queries with Neural Networks 2023 SIGMOD 5.2037933e-05
9,381 Efficient and Effective Cardinality Estimation for Skyline Family 2023 SIGMOD 5.1843659e-05
9,556 Athena: An Effective Learning-based Framework for Query Optimizer Performance Improvement 2025 SIGMOD 5.1580326e-05
9,654 Are Joins over LSM-trees Ready? Take RocksDB as an Example 2025 VLDB 5.142891e-05
9,723 A Practical Theory of Generalization in Selectivity Learning 2025 VLDB 5.1329654e-05
9,962 Graph Transformers for Query Plan Representation: Potentials and Challenges 2025 VLDB 5.1014161e-05
9,983 Selectivity Estimation for Queries Containing Predicates over Set-Valued Attributes 2023 SIGMOD 5.1007226e-05
10,107 Still Asking: How Good Are Query Optimizers, Really? 2025 VLDB 5.0765311e-05
10,222 PRICE: A Pretrained Model for Cross-Database Cardinality Estimation 2025 VLDB 5.0560976e-05
10,300 Data-Agnostic Cardinality Learning from Imperfect Workloads 2025 VLDB 5.0407989e-05
10,343 An Elephant Under The Microscope: Analyzing The Interaction Of Optimizer Components In PostgreSQL 2025 SIGMOD 5.0176429e-05
10,684 Qualitative Join Discovery in Data Lakes using Examples 2026 SIGMOD 4.9769913e-05
10,703 Practical Parameterized Query Optimization via Efficient Plan Reuse and List-wise Ranking 2026 SIGMOD 4.9769913e-05
10,812 BaCon: Efficient Batch Processing of Counting Queries 2026 VLDB 4.9769913e-05
11,265 ACE: A Cardinality Estimator for Set-Valued Queries 2025 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
37 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.0004772731
79 Practical Selectivity Estimation through Adaptive Sampling 1990 SIGMOD 0.00036476265
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034099838
160 CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies 2004 SIGMOD 0.00027827605
286 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.00022112534
318 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021166957
371 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00019822444
386 Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors 2009 VLDB 0.00019446558
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019050182
454 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00017955913
462 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017836105
510 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017059914
688 Cardinality Estimation Done Right: Index-Based Join Sampling 2017 CIDR 0.00014749318
691 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014737455
700 Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data 2001 SIGMOD 0.00014675903
743 Dynamic Multidimensional Histograms 2002 SIGMOD 0.00014309723
795 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013934719
867 Approximating Multi-Dimensional Aggregate Range Queries Over Real Attributes 2000 SIGMOD 0.00013376165
955 Selectivity Estimation and Query Optimization in Large Databases with Highly Skewed Distributions of Column Values 1988 VLDB 0.0001286095
1,058 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012224038
1,155 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011777046
1,432 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010676754
1,465 Pessimistic Cardinality Estimation: Tighter Upper Bounds for Intermediate Join Cardinalities 2019 SIGMOD 0.00010572023
1,467 On the Relative Cost of Sampling for Join Selectivity Estimation 1994 PODS 0.00010563809
1,509 Self-Tuning, GPU-Accelerated Kernel Density Models for Multidimensional Selectivity Estimation 2015 SIGMOD 0.00010436933
1,580 Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries 2020 SIGMOD 0.00010177136
1,687 Global Optimization of Histograms 2001 SIGMOD 9.8614576e-05
2,142 SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads 2003 VLDB 8.9644817e-05
2,217 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.8151982e-05
2,414 Data Generation using Declarative Constraints 2011 SIGMOD 8.5054535e-05
3,000 Multiple Join Size Estimation by Virtual Domains (extended abstract) 1993 PODS 7.7657164e-05
3,852 Graph-Based Synopses for Relational Selectivity Estimation 2006 SIGMOD 6.9756022e-05
4,093 Generating Databases for Query Workloads 2010 VLDB 6.809504e-05
5,829 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9764044e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,032 Cardinality Estimation of LIKE Predicate Queries using Deep Learning 2025 SIGMOD
2 85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR
3 1,065 Are We Ready For Learned Cardinality Estimation? 2021 VLDB
4 2,342 Learned Cardinality Estimation: An In-depth Study 2022 SIGMOD
5 9,381 Efficient and Effective Cardinality Estimation for Skyline Family 2023 SIGMOD
6 1,580 Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries 2020 SIGMOD
7 7,420 Cardinality Estimation of Approximate Substring Queries using Deep Learning 2022 VLDB
8 5,630 Sample-Efficient Cardinality Estimation Using Geometric Deep Learning 2024 VLDB
9 2,518 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB
10 406 Deep Unsupervised Cardinality Estimation 2020 VLDB