DBScholar

Back to papers

CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies

Summary: CORDS automatically discovers correlations and soft functional dependencies among columns via sampling and chi-squared tests. Outputs dependency graphs and column-group statistics to guide optimizers, boosting selectivity estimates and speeding queries. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hb3fd2d921c16981c
Venue
SIGMOD
Year
2004
Pagerank
0.00027837289
Overall Rank
160 | 98.93%
DOI
10.1145/1007568.1007641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ilyas_sigmod04,
        title = {{CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies}},
        author = {Ilyas, Ihab F. and Markl, Volker and Haas, Peter and Brown, Paul and Aboulnaga, Ashraf},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007641},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007641},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 80 citing papers.

Rank Citing Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
145 Neo: A Learned Query Optimizer 2019 VLDB 0.0002908188
314 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00021282642
350 Discovering Denial Constraints 2013 VLDB 0.00020253521
587 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015933201
692 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014741011
696 MYSTIQ: A system for finding more answers by using probabilities 2005 SIGMOD 0.00014697176
727 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB 0.00014443394
1,031 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012405065
1,060 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012224575
1,099 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012037058
1,156 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011777105
1,191 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011590153
1,257 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011310561
1,293 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.00011149857
1,488 Efficient Discovery of Approximate Dependencies 2018 VLDB 0.00010517437
1,929 Consistently Estimating the Selectivity of Conjuncts of Predicates 2005 VLDB 9.3546057e-05
2,160 DIFF: A Relational Interface for Large-Scale Data Explanation 2019 VLDB 8.9364035e-05
2,216 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.8177753e-05
2,238 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.7751619e-05
2,329 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.6292256e-05
2,371 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5615698e-05
2,433 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.4766785e-05
2,718 Answering Queries from Statistics and Probabilistic Views 2005 VLDB 8.0978764e-05
2,748 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0610697e-05
2,904 Estimating the Confidence of Conditional Functional Dependencies 2009 SIGMOD 7.8801067e-05
2,960 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.8075103e-05
3,052 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.7052471e-05
3,073 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6777283e-05
3,131 Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates 2019 CIDR 7.6141006e-05
3,193 A Statistical Perspective on Discovering Functional Dependencies in Noisy Data 2020 SIGMOD 7.5505481e-05
3,418 Data Profiling – A Tutorial 2017 SIGMOD 7.3210362e-05
3,431 Data Generation for Application-Specific Benchmarking 2011 VLDB 7.3049534e-05
3,500 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB 7.2534237e-05
3,778 Optimizing Video Analytics with Declarative Model Relationships 2023 VLDB 7.0259119e-05
3,969 Optimizing Machine Learning Inference Queries with Correlative Proxy Models 2022 VLDB 6.8899861e-05
3,988 Exploiting Correlations for Expensive Predicate Evaluation 2015 SIGMOD 6.871854e-05
4,069 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.821366e-05
4,088 Automatic Generation of Normalized Relational Schemas from Nested Key-Value Data 2016 SIGMOD 6.8148416e-05
4,106 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.8032891e-05
4,226 Scalable Discovery of Unique Column Combinations 2014 VLDB 6.7183259e-05
4,287 VIVA: An End-to-End System for Interactive Video Analytics 2022 CIDR 6.6869736e-05
4,342 Possible and Certain SQL Keys 2015 VLDB 6.6510065e-05
4,424 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.6048065e-05
4,650 Temporal Rules Discovery for Web Data Cleaning 2016 VLDB 6.4858157e-05
4,659 Automated Statistics Collection in DB2 UDB 2004 VLDB 6.4822228e-05
5,267 Predicting Cost Amortization for Query Services 2011 SIGMOD 6.2016737e-05
5,357 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1619918e-05
5,597 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.0718206e-05
5,840 Pre-training Summarization Models of Structured Datasets for Cardinality Estimation 2022 VLDB 5.9737703e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034106982
286 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.0002211981
371 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00019829769
454 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00017962189
620 Mining Quantitative Association Rules in Large Relational Tables 1996 SIGMOD 0.00015502611
646 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.0001520859
701 Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data 2001 SIGMOD 0.00014680907
1,662 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 9.9465656e-05
2,140 SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads 2003 VLDB 8.9682092e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,627 CorrBound: Cardinality Estimation Accounting for Inter- and Intra-relation Correlations 2026 SIGMOD
2 727 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB
3 12,046 Making DBMSes Dependency-Aware 2020 CIDR
4 2,329 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB
5 8,851 Workload-driven, Lazy Discovery of Data Dependencies for Query Optimization 2022 CIDR
6 3,090 Correlation Sketches for Approximate Join-Correlation Queries 2021 SIGMOD
7 3,500 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB
8 6,074 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB
9 9,845 Detecting Attribute Dependencies from Query Feedback 2007 VLDB
10 8,173 CORDS: Automatic Generation of Correlation Statistics in DB2 2004 VLDB