DBScholar

Back to papers

CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies

Summary: CORDS automatically discovers correlations and soft functional dependencies among columns via sampling and chi-squared tests. Outputs dependency graphs and column-group statistics to guide optimizers, boosting selectivity estimates and speeding queries. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hb3fd2d921c16981c
Venue
SIGMOD
Year
2004
Pagerank
0.00027775994
Overall Rank
160 | 98.93%
DOI
10.1145/1007568.1007641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ilyas_sigmod04,
        title = {{CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies}},
        author = {Ilyas, Ihab F. and Markl, Volker and Haas, Peter and Brown, Paul and Aboulnaga, Ashraf},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007641},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007641},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 80 citing papers.

Rank Citing Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061463175
142 Neo: A Learned Query Optimizer 2019 VLDB 0.00029114937
309 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.0002143249
348 Discovering Denial Constraints 2013 VLDB 0.00020216677
590 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015876538
690 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014703258
699 MYSTIQ: A system for finding more answers by using probabilities 2005 SIGMOD 0.00014645232
727 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB 0.00014426954
1,033 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012373297
1,061 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012207625
1,099 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012008783
1,156 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011759683
1,190 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011564169
1,261 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011289724
1,268 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.00011243615
1,490 Efficient Discovery of Approximate Dependencies 2018 VLDB 0.0001047928
1,935 Consistently Estimating the Selectivity of Conjuncts of Predicates 2005 VLDB 9.3407959e-05
2,167 DIFF: A Relational Interface for Large-Scale Data Explanation 2019 VLDB 8.9166414e-05
2,228 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.7912743e-05
2,249 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.7479608e-05
2,337 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.6002736e-05
2,373 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5434538e-05
2,438 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.4532693e-05
2,729 Answering Queries from Statistics and Probabilistic Views 2005 VLDB 8.0681587e-05
2,752 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0387193e-05
2,914 Estimating the Confidence of Conditional Functional Dependencies 2009 SIGMOD 7.85486e-05
2,960 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.7967245e-05
3,060 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.6828463e-05
3,081 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6515625e-05
3,136 Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates 2019 CIDR 7.5902303e-05
3,205 A Statistical Perspective on Discovering Functional Dependencies in Noisy Data 2020 SIGMOD 7.5221127e-05
3,420 Data Profiling – A Tutorial 2017 SIGMOD 7.300051e-05
3,442 Data Generation for Application-Specific Benchmarking 2011 VLDB 7.2783187e-05
3,509 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB 7.2279142e-05
3,782 Optimizing Video Analytics with Declarative Model Relationships 2023 VLDB 7.0029633e-05
3,966 Optimizing Machine Learning Inference Queries with Correlative Proxy Models 2022 VLDB 6.8776157e-05
4,000 Exploiting Correlations for Expensive Predicate Evaluation 2015 SIGMOD 6.8489751e-05
4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.7973616e-05
4,111 Automatic Generation of Normalized Relational Schemas from Nested Key-Value Data 2016 SIGMOD 6.7891131e-05
4,122 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.7810085e-05
4,245 Scalable Discovery of Unique Column Combinations 2014 VLDB 6.6958006e-05
4,284 VIVA: An End-to-End System for Interactive Video Analytics 2022 CIDR 6.6710929e-05
4,361 Possible and Certain SQL Keys 2015 VLDB 6.6271978e-05
4,444 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.5812416e-05
4,653 Temporal Rules Discovery for Web Data Cleaning 2016 VLDB 6.4706099e-05
4,672 Automated Statistics Collection in DB2 UDB 2004 VLDB 6.4593469e-05
5,293 Predicting Cost Amortization for Query Services 2011 SIGMOD 6.178241e-05
5,377 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1396287e-05
5,611 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.0498181e-05
5,837 Pre-training Summarization Models of Structured Datasets for Cardinality Estimation 2022 VLDB 5.9600736e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034050614
287 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.00022060616
372 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00019768921
457 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00017915659
622 Mining Quantitative Association Rules in Large Relational Tables 1996 SIGMOD 0.00015452634
646 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.00015166402
701 Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data 2001 SIGMOD 0.0001464136
1,670 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 9.9124313e-05
2,154 SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads 2003 VLDB 8.9382906e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,699 CorrBound: Cardinality Estimation Accounting for Inter- and Intra-relation Correlations 2026 SIGMOD
2 727 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB
3 12,096 Making DBMSes Dependency-Aware 2020 CIDR
4 2,337 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB
5 8,873 Workload-driven, Lazy Discovery of Data Dependencies for Query Optimization 2022 CIDR
6 3,093 Correlation Sketches for Approximate Join-Correlation Queries 2021 SIGMOD
7 3,509 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB
8 6,092 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB
9 9,888 Detecting Attribute Dependencies from Query Feedback 2007 VLDB
10 8,196 CORDS: Automatic Generation of Correlation Statistics in DB2 2004 VLDB