DBScholar

Back to papers

Flow-Loss: Learning Cardinality Estimates That Matter

Summary: Flow-Loss trains cardinality estimators against optimizer plan costs via a flow-routing formulation over plan graphs, rather than average Q-Error. On the 16K-query CEB benchmark, it yields better runtimes and markedly stronger generalization to unseen templates despite worse estimation accuracy. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h0ecc8025d49f0dab
Venue
VLDB
Year
2021
Pagerank
9.7566604e-05
Overall Rank
1,735 | 88.35%
DOI
10.14778/3476249.3476259
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{negi_vldb21,
        title = {{Flow-Loss: Learning Cardinality Estimates That Matter}},
        author = {Negi, Parimarjan and Marcus, Ryan and Kipf, Andreas and Mao, Hongzi and Tatbul, Nesime and Kraska, Tim and Alizadeh, Mohammad},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {11},
        pages = {2019--2032},
        doi = {10.14778/3476249.3476259},
        url = {https://doi.org/10.14778/3476249.3476259},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 60 citing papers.

Rank Citing Paper Year Venue Pagerank
981 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012713454
2,342 Learned Cardinality Estimation: An In-depth Study 2022 SIGMOD 8.6074783e-05
2,583 Fauce: Fast and Accurate Deep Ensembles with Uncertainty for Cardinality Estimation 2021 VLDB 8.2589842e-05
2,844 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9446987e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4233639e-05
4,191 Kepler: Robust Learning for Faster Parametric Query Optimization 2023 SIGMOD 6.7425275e-05
4,240 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.7064546e-05
4,299 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.6766173e-05
4,677 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 6.4721041e-05
5,020 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.3096708e-05
5,062 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.2896995e-05
5,224 SafeBound: A Practical System for Generating Cardinality Bounds 2023 SIGMOD 6.2197808e-05
5,630 Sample-Efficient Cardinality Estimation Using Geometric Deep Learning 2024 VLDB 6.056758e-05
5,895 Yannakakis+: Practical Acyclic Query Evaluation with Theoretical Guarantees 2025 SIGMOD 5.9534254e-05
5,973 Towards instance-optimized data systems 2021 VLDB 5.9281867e-05
6,408 A Unified Transferable Model for ML-Enhanced DBMS 2022 CIDR 5.7921918e-05
6,664 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.715134e-05
6,796 dbET: Execution Time Distribution-based Plan Selection 2023 SIGMOD 5.6784895e-05
6,824 ASM: Harmonizing Autoregressive Model, Sampling, and Multi-dimensional Statistics Merging for Cardinality Estimation 2024 SIGMOD 5.670071e-05
7,072 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.6053987e-05
7,356 PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost! 2021 VLDB 5.5421826e-05
7,546 Learned Offline Query Planning via Bayesian Optimization 2025 SIGMOD 5.4966669e-05
7,810 Parachute: Single-Pass Bi-Directional Information Passing 2025 VLDB 5.4477354e-05
7,813 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4474823e-05
7,826 Bespoke OLAP: Synthesizing Workload-Specific One-size-fits-one Database Engines 2026 VLDB 5.4435842e-05
8,009 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning 2024 VLDB 5.4063491e-05
8,638 LIMAO: A Framework for Lifelong Modular Learned Query Optimization 2025 VLDB 5.2965922e-05
8,888 Spatial Query Optimization With Learning 2024 VLDB 5.2543468e-05
8,952 Machine Unlearning in Learned Databases: An Experimental Analysis 2024 SIGMOD 5.2517414e-05
8,969 Conformal Prediction for Verifiable Learned Query Optimization 2025 VLDB 5.2477982e-05
9,124 Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data Meshes 2023 VLDB 5.2247088e-05
9,221 DPconv: Super-Polynomially Faster Join Ordering 2024 SIGMOD 5.2036474e-05
9,556 Athena: An Effective Learning-based Framework for Query Optimizer Performance Improvement 2025 SIGMOD 5.1580326e-05
9,635 Low Rank Learning for Offline Query Optimization 2025 SIGMOD 5.1453041e-05
9,654 Are Joins over LSM-trees Ready? Take RocksDB as an Example 2025 VLDB 5.142891e-05
9,723 A Practical Theory of Generalization in Selectivity Learning 2025 VLDB 5.1329654e-05
9,900 Approximate Sketches 2024 SIGMOD 5.1110481e-05
9,962 Graph Transformers for Query Plan Representation: Potentials and Challenges 2025 VLDB 5.1014161e-05
10,107 Still Asking: How Good Are Query Optimizers, Really? 2025 VLDB 5.0765311e-05
10,144 How to Optimize SQL Queries? A Comparison Between Split, Holistic, and Hybrid Approaches 2025 VLDB 5.0718686e-05
10,212 Turbo-Charging SPJ Query Plans with Learned Physical Join Operator Selections 2022 VLDB 5.0579923e-05
10,248 Redbench: Workload Synthesis From Cloud Traces 2026 VLDB 5.0501823e-05
10,300 Data-Agnostic Cardinality Learning from Imperfect Workloads 2025 VLDB 5.0407989e-05
10,343 An Elephant Under The Microscope: Analyzing The Interaction Of Optimizer Components In PostgreSQL 2025 SIGMOD 5.0176429e-05
10,424 Are Learned DBMS Components Robust to Workload Drift?: [Experiments & Analysis] 2026 SIGMOD 4.9769913e-05
10,495 NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling: [Experiments & Analysis] 2026 SIGMOD 4.9769913e-05
10,555 Approximate Query Processing under Updates 2026 SIGMOD 4.9769913e-05
10,607 SEFRQO: A Self-Evolving Fine-Tuned RAG-Based Query Optimizer 2026 SIGMOD 4.9769913e-05
10,690 Reqo: A Comprehensive Learning-Based Cost Model for Robust and Explainable Query Optimization 2026 SIGMOD 4.9769913e-05
10,703 Practical Parameterized Query Optimization via Efficient Plan Reuse and List-wise Ranking 2026 SIGMOD 4.9769913e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
103 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00033884854
144 Neo: A Learned Query Optimizer 2019 VLDB 0.00029090793
169 Wavelet-Based Histograms for Selectivity Estimation 1998 SIGMOD 0.00027126333
286 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.00022112534
318 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021166957
371 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00019822444
386 Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors 2009 VLDB 0.00019446558
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019050182
462 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017836105
510 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017059914
596 Wander Join: Online Aggregation via Random Walks 2016 SIGMOD 0.00015782051
688 Cardinality Estimation Done Right: Index-Based Join Sampling 2017 CIDR 0.00014749318
691 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014737455
795 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013934719
1,065 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012202293
1,155 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011777046
1,432 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010676754
1,465 Pessimistic Cardinality Estimation: Tighter Upper Bounds for Intermediate Join Cardinalities 2019 SIGMOD 0.00010572023
1,580 Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries 2020 SIGMOD 0.00010177136
1,605 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2019 SIGMOD 0.00010095581
2,217 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.8151982e-05
2,975 Accurate Summary-based Cardinality Estimation Through the Lens of Cardinality Estimation Graphs 2022 VLDB 7.7905662e-05
3,057 Towards a Hands-Free Query Optimizer through Deep Learning 2019 CIDR 7.6960881e-05
3,208 Efficiently Approximating Selectivity Functions using Low Overhead Regression Models 2020 VLDB 7.5355264e-05
3,272 Estimating Cardinalities with Deep Sketches 2019 SIGMOD 7.4711788e-05
3,983 Simplicity Done Right for Join Ordering 2021 CIDR 6.8722161e-05
Previous Page 1 / 1 Next

Semantically Similar Papers