DBScholar

Back to papers

CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies

Summary: CORDS automatically discovers correlations and soft functional dependencies among columns via sampling and chi-squared tests. Outputs dependency graphs and column-group statistics to guide optimizers, boosting selectivity estimates and speeding queries. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
3618
Venue
SIGMOD
Year
2004
Pagerank
0.00028129426
Overall Rank
159 | 98.92%
DOI
10.1145/1007568.1007641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ilyas_sigmod04,
        title = {{CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies}},
        author = {Ilyas, Ihab F. and Markl, Volker and Haas, Peter and Brown, Paul and Aboulnaga, Ashraf},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007641},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007641},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 80 citing papers.

Rank Citing Paper Year Venue Pagerank
18 How Good Are Query Optimizers, Really? 2016 VLDB 0.00059284255
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
334 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00020875082
376 Discovering Denial Constraints 2013 VLDB 0.00019677674
574 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00016278855
683 MYSTIQ: A system for finding more answers by using probabilities 2005 SIGMOD 0.00015005338
697 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014888851
729 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB 0.00014539421
1,033 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012529852
1,071 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012322342
1,101 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012168934
1,170 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011827259
1,174 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011817414
1,256 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011457194
1,303 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.0001123653
1,500 Efficient Discovery of Approximate Dependencies 2018 VLDB 0.00010561098
1,936 Consistently Estimating the Selectivity of Conjuncts of Predicates 2005 VLDB 9.4557372e-05
2,161 DIFF: A Relational Interface for Large-Scale Data Explanation 2019 VLDB 9.0606664e-05
2,203 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.9610447e-05
2,213 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.9410226e-05
2,302 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.7808696e-05
2,404 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.6225576e-05
2,687 Answering Queries from Statistics and Probabilistic Views 2005 VLDB 8.2579315e-05
2,728 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.1995954e-05
2,872 Estimating the Confidence of Conditional Functional Dependencies 2009 SIGMOD 8.0104819e-05
3,004 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 7.8608629e-05
3,086 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.7708642e-05
3,137 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.7204167e-05
3,147 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.7077175e-05
3,215 Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates 2019 CIDR 7.6324234e-05
3,387 Data Profiling – A Tutorial 2017 SIGMOD 7.4534663e-05
3,404 Data Generation for Application-Specific Benchmarking 2011 VLDB 7.4411075e-05
3,441 A Statistical Perspective on Discovering Functional Dependencies in Noisy Data 2020 SIGMOD 7.4138323e-05
3,449 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB 7.4074656e-05
3,945 Exploiting Correlations for Expensive Predicate Evaluation 2015 SIGMOD 7.0055154e-05
4,007 Optimizing Video Analytics with Declarative Model Relationships 2023 VLDB 6.9632395e-05
4,014 Automatic Generation of Normalized Relational Schemas from Nested Key-Value Data 2016 SIGMOD 6.956076e-05
4,114 Optimizing Machine Learning Inference Queries with Correlative Proxy Models 2022 VLDB 6.8941194e-05
4,183 Scalable Discovery of Unique Column Combinations 2014 VLDB 6.8467773e-05
4,256 VIVA: An End-to-End System for Interactive Video Analytics 2022 CIDR 6.8018439e-05
4,303 Possible and Certain SQL Keys 2015 VLDB 6.7711902e-05
4,383 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.7329787e-05
4,412 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.7168614e-05
4,481 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.6754521e-05
4,591 Automated Statistics Collection in DB2 UDB 2004 VLDB 6.614318e-05
4,598 Temporal Rules Discovery for Web Data Cleaning 2016 VLDB 6.6127851e-05
5,176 Predicting Cost Amortization for Query Services 2011 SIGMOD 6.3326746e-05
5,354 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.2515841e-05
5,514 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.1901666e-05
5,733 A Dip in the Reservoir: Maintaining Sample Synopses of Evolving Datasets 2006 VLDB 6.1062071e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
100 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034385207
280 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.00022454217
365 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00020041735
448 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00018292618
606 Mining Quantitative Association Rules in Large Relational Tables 1996 SIGMOD 0.00015804851
664 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.00015167825
692 Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data 2001 SIGMOD 0.00014919816
1,648 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 0.00010120668
2,121 SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads 2003 VLDB 9.1402718e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,438 CorrBound: Cardinality Estimation Accounting for Inter- and Intra-relation Correlations 2026 SIGMOD
2 729 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB
3 11,743 Making DBMSes Dependency-Aware 2020 CIDR
4 2,302 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB
5 8,684 Workload-driven, Lazy Discovery of Data Dependencies for Query Optimization 2022 CIDR
6 3,228 Correlation Sketches for Approximate Join-Correlation Queries 2021 SIGMOD
7 3,449 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB
8 6,044 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB
9 9,671 Detecting Attribute Dependencies from Query Feedback 2007 VLDB
10 8,012 CORDS: Automatic Generation of Correlation Statistics in DB2 2004 VLDB