DBScholar

Back to papers

Exploiting Soft and Hard Correlations in Big Data Query Optimization

Summary: EXORD exploits guaranteed and uncertain attribute correlations in big-data optimization, validating soft rules and isolating violating records. A workload-aware cost-benefit heuristic selects useful correlations for Hive/Hadoop, integrating with indexing and partitioning for over 10× speedups. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11400
Venue
VLDB
Year
2016
Pagerank
5.995949e-05
Overall Rank
6,044 | 58.54%
DOI
10.14778/2994509.2994514

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{liu_vldb16,
        title = {{Exploiting Soft and Hard Correlations in Big Data Query Optimization}},
        author = {Liu, Hai and Xiao, Dongqing and Didwania, Pankaj and Eltabakh, Mohamed Y.},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {12},
        pages = {1005--1016},
        doi = {10.14778/2994509.2994514},
        url = {https://doi.org/10.14778/2994509.2994514},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank Citing Paper Year Venue Pagerank
1,955 Discovery of Approximate (and Exact) Denial Constraints 2020 VLDB 9.4166032e-05
6,423 Memory-Aware Framework for Efficient Second-Order Random Walk on Large Graphs 2020 SIGMOD 5.8813146e-05
9,561 Leveraging Application Data Constraints to Optimize Database-Backed Web Applications 2023 VLDB 5.2528121e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
159 CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies 2004 SIGMOD 0.00028129426
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
376 Discovering Denial Constraints 2013 VLDB 0.00019677674
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
660 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00015198804
803 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013899943
1,436 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010797443
1,648 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 0.00010120668
1,791 Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce 2010 VLDB 9.7470504e-05
1,883 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.5421713e-05
2,302 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.7808696e-05
2,642 CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop 2011 VLDB 8.3059948e-05
3,449 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB 7.4074656e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,438 CorrBound: Cardinality Estimation Accounting for Inter- and Intra-relation Correlations 2026 SIGMOD
2 3,449 CORADD: Correlation Aware Database Designer for Materialized Views and Indexes 2010 VLDB
3 566 Towards a Robust Query Optimizer: A Principled and Practical Approach 2005 SIGMOD
4 8,996 High Performance Stream Query Processing With Correlation-Aware Partitioning 2014 VLDB
5 3,228 Correlation Sketches for Approximate Join-Correlation Queries 2021 SIGMOD
6 2,302 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB
7 8,012 CORDS: Automatic Generation of Correlation Statistics in DB2 2004 VLDB
8 8,965 Sharing-Aware Horizontal Partitioning for Exploiting Correlations During Query Processing 2010 VLDB
9 159 CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies 2004 SIGMOD
10 4,481 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD