DBScholar

Back to papers

Qd-tree: Learning Data Layouts for Big Data Analytics

Summary: qd-tree: learning-based data layouts route records to storage blocks, minimizing I/O for analytics. Two methods, greedy and deep RL, build the qd-tree, delivering large I/O speedups over blocking and near 2× data-skipping lower bound, with semantic block descriptions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44f80a71990639c4
Venue
SIGMOD
Year
2020
Pagerank
0.00011901941
Overall Rank
1,128 | 92.43%
DOI
10.1145/3318464.3389770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{yang_sigmod20,
        title = {{Qd-tree: Learning Data Layouts for Big Data Analytics}},
        author = {Yang, Zongheng and Chandramouli, Badrish and Wang, Chi and Gehrke, Johannes and Li, Yinan and Minhas, Umar Farooq and Larson, Per-Åke and Kossmann, Donald and Acharya, Rajeev},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389770},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389770},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank Citing Paper Year Venue Pagerank
422 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018488849
510 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017059914
1,188 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011598149
1,245 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.0001136308
1,373 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010891169
1,525 Updatable Learned Index with Precise Positions 2021 VLDB 0.00010355133
1,877 Effectively Learning Spatial Indices 2020 VLDB 9.4498401e-05
2,582 Are Updatable Learned Indexes Ready? 2022 VLDB 8.2641447e-05
2,765 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0401855e-05
2,861 APEX: A High-Performance Learned Index on Persistent Memory 2022 VLDB 7.9295281e-05
3,621 Learned Index: A Comprehensive Experimental Evaluation 2023 VLDB 7.1510804e-05
3,648 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 7.1366536e-05
4,638 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 6.4901967e-05
4,851 The RLR-Tree: A Reinforcement Learning Based R-Tree for Spatial Data 2023 SIGMOD 6.377837e-05
5,043 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.2979214e-05
5,842 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.971167e-05
5,917 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9469335e-05
5,929 Self-Organizing Data Containers 2022 CIDR 5.9411211e-05
5,973 Towards instance-optimized data systems 2021 VLDB 5.9281867e-05
6,027 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.9089922e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8373399e-05
6,597 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves 2023 VLDB 5.7386302e-05
6,600 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.737874e-05
6,715 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6989853e-05
6,971 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.628441e-05
7,247 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5734736e-05
7,570 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4929234e-05
7,604 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4846038e-05
8,159 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 5.3866275e-05
8,186 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3800965e-05
8,204 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.3769515e-05
8,389 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.3396465e-05
8,402 The Case for Learned In-Memory Joins 2023 VLDB 5.3375308e-05
8,423 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.3324907e-05
8,839 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2658345e-05
9,925 Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity 2023 VLDB 5.1079647e-05
10,007 BT-Tree: A Reinforcement Learning Based Index for Big Trajectory Data 2024 SIGMOD 5.0954911e-05
10,053 Adaptive Indexing of Objects with Spatial Extent 2023 VLDB 5.0875233e-05
10,104 Adaptive data transformations for QaaS 2025 CIDR 5.0765311e-05
10,172 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.0658661e-05
10,630 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.9769913e-05
10,667 LM-Tree: A Hybrid Learned Index for Similarity Search in Metric Spaces 2026 SIGMOD 4.9769913e-05
10,713 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.9769913e-05
11,122 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9769913e-05
11,733 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
2 R-Trees: A Dynamic Index Structure For Spatial Searching 1984 SIGMOD 0.0019923528
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046363107
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041210636
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036675568
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030749898
144 Neo: A Learned Query Optimizer 2019 VLDB 0.00029090793
187 DB2 Design Advisor: Integrated Automatic Physical Database Design 2004 VLDB 0.00025914764
195 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025619089
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485637
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023349603
252 Database Cracking 2007 CIDR 0.00023101361
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019050182
422 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018488849
461 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017841988
473 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00017684278
691 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014737455
869 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013363241
944 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00012934104
1,036 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012372946
1,200 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011559584
1,837 Merging What's Cracked, Cracking What's Merged: Adaptive Indexing in Main-Memory Column-Stores 2011 VLDB 9.5315292e-05
1,891 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 9.4233024e-05
2,290 Clay: Fine-Grained Adaptive Partitioning for General Database Schemas 2017 VLDB 8.6873304e-05
2,374 To Tune or not to Tune? A Lightweight Physical Design Alerter 2006 VLDB 8.5570131e-05
2,880 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.9118308e-05
3,083 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.6620866e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2954357e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2911896e-05
3,857 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.9662462e-05
5,827 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB 5.9772416e-05
Previous Page 1 / 1 Next

Semantically Similar Papers