DBScholar

Back to papers

CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies

Summary: CORDS automatically discovers correlations and soft functional dependencies among columns via sampling and chi-squared tests. Outputs dependency graphs and column-group statistics to guide optimizers, boosting selectivity estimates and speeding queries. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hb3fd2d921c16981c
Venue
SIGMOD
Year
2004
Pagerank
0.00027827605
Overall Rank
160 | 98.93%
DOI
10.1145/1007568.1007641

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ilyas_sigmod04,
        title = {{CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies}},
        author = {Ilyas, Ihab F. and Markl, Volker and Haas, Peter and Brown, Paul and Aboulnaga, Ashraf},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007641},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007641},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 80 citing papers.

Rank Citing Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
144 Neo: A Learned Query Optimizer 2019 VLDB 0.00029090793
314 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00021276452
350 Discovering Denial Constraints 2013 VLDB 0.00020244085
587 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015927027
691 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014737455
696 MYSTIQ: A system for finding more answers by using probabilities 2005 SIGMOD 0.00014691377
728 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB 0.00014436728
1,031 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012399252
1,058 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012224038
1,098 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012031983
1,155 QuickSel: Quick Selectivity Learning with Mixture Models 2020 SIGMOD 0.00011777046
1,188 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011598149
1,258 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011308863
1,293 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.00011144991
1,488 Efficient Discovery of Approximate Dependencies 2018 VLDB 0.00010513265
1,931 Consistently Estimating the Selectivity of Conjuncts of Predicates 2005 VLDB 9.3511556e-05
2,162 DIFF: A Relational Interface for Large-Scale Data Explanation 2019 VLDB 8.9344773e-05
2,217 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.8151982e-05
2,237 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.7738349e-05
2,326 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.628257e-05
2,372 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5575299e-05
2,432 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.4742372e-05
2,718 Answering Queries from Statistics and Probabilistic Views 2005 VLDB 8.094465e-05
2,748 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0572603e-05
2,904 Estimating the Confidence of Conditional Functional Dependencies 2009 SIGMOD 7.87641e-05
2,962 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.8038782e-05
3,053 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.7041081e-05
3,075 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6742518e-05
3,132 Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates 2019 CIDR 7.6107287e-05
3,194 A Statistical Perspective on Discovering Functional Dependencies in Noisy Data 2020 SIGMOD 7.5469742e-05
3,419 Data Profiling – A Tutorial 2017 SIGMOD 7.3175997e-05
3,431 Data Generation for Application-Specific Benchmarking 2011 VLDB 7.3018233e-05
3,500 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB 7.2506844e-05
3,780 Optimizing Video Analytics with Declarative Model Relationships 2023 VLDB 7.0225859e-05
3,971 Optimizing Machine Learning Inference Queries with Correlative Proxy Models 2022 VLDB 6.8868815e-05
3,988 Exploiting Correlations for Expensive Predicate Evaluation 2015 SIGMOD 6.8694751e-05
4,069 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.8184364e-05
4,091 Automatic Generation of Normalized Relational Schemas from Nested Key-Value Data 2016 SIGMOD 6.8116205e-05
4,108 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.8000756e-05
4,226 Scalable Discovery of Unique Column Combinations 2014 VLDB 6.7151469e-05
4,273 VIVA: An End-to-End System for Interactive Video Analytics 2022 CIDR 6.6895276e-05
4,342 Possible and Certain SQL Keys 2015 VLDB 6.6478954e-05
4,426 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.601896e-05
4,652 Temporal Rules Discovery for Web Data Cleaning 2016 VLDB 6.4828106e-05
4,660 Automated Statistics Collection in DB2 UDB 2004 VLDB 6.4794337e-05
5,272 Predicting Cost Amortization for Query Services 2011 SIGMOD 6.1987379e-05
5,362 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1592249e-05
5,598 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.0690976e-05
5,835 Pre-training Summarization Models of Structured Datasets for Cardinality Estimation 2022 VLDB 5.9737602e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034099838
286 Selectivity Estimation using Probabilistic Models 2001 SIGMOD 0.00022112534
371 STHoles: A Multidimensional Workload-Aware Histogram 2001 SIGMOD 0.00019822444
454 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00017955913
620 Mining Quantitative Association Rules in Large Relational Tables 1996 SIGMOD 0.00015495576
644 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.00015209065
700 Independence is Good: Dependency-Based Histogram Synopses for High-Dimensional Data 2001 SIGMOD 0.00014675903
1,663 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 9.942673e-05
2,142 SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads 2003 VLDB 8.9644817e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,638 CorrBound: Cardinality Estimation Accounting for Inter- and Intra-relation Correlations 2026 SIGMOD
2 728 Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms 2015 VLDB
3 12,052 Making DBMSes Dependency-Aware 2020 CIDR
4 2,326 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB
5 8,861 Workload-driven, Lazy Discovery of Data Dependencies for Query Optimization 2022 CIDR
6 3,092 Correlation Sketches for Approximate Join-Correlation Queries 2021 SIGMOD
7 3,500 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB
8 6,076 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB
9 9,852 Detecting Attribute Dependencies from Query Feedback 2007 VLDB
10 8,180 CORDS: Automatic Generation of Correlation Statistics in DB2 2004 VLDB