DBScholar

Back to papers

Qd-tree: Learning Data Layouts for Big Data Analytics

Summary: qd-tree: learning-based data layouts route records to storage blocks, minimizing I/O for analytics. Two methods, greedy and deep RL, build the qd-tree, delivering large I/O speedups over blocking and near 2× data-skipping lower bound, with semantic block descriptions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44f80a71990639c4
Venue
SIGMOD
Year
2020
Pagerank
0.00011898257
Overall Rank
1,132 | 92.40%
DOI
10.1145/3318464.3389770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{yang_sigmod20,
        title = {{Qd-tree: Learning Data Layouts for Big Data Analytics}},
        author = {Yang, Zongheng and Chandramouli, Badrish and Wang, Chi and Gehrke, Johannes and Li, Yinan and Minhas, Umar Farooq and Larson, Per-Åke and Kossmann, Donald and Acharya, Rajeev},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389770},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389770},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank Citing Paper Year Venue Pagerank
430 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018409112
512 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017050173
1,191 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011590153
1,250 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011339256
1,373 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.0001088854
1,550 Updatable Learned Index with Precise Positions 2021 VLDB 0.00010282449
1,878 Effectively Learning Spatial Indices 2020 VLDB 9.4451309e-05
2,636 Are Updatable Learned Indexes Ready? 2022 VLDB 8.1941043e-05
2,765 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0439015e-05
2,866 APEX: A High-Performance Learned Index on Persistent Memory 2022 VLDB 7.9258875e-05
3,645 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 7.1397796e-05
3,697 Learned Index: A Comprehensive Experimental Evaluation 2023 VLDB 7.0882335e-05
4,635 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 6.4932705e-05
4,850 The RLR-Tree: A Reinforcement Learning Based R-Tree for Spatial Data 2023 SIGMOD 6.3808017e-05
5,041 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.3006152e-05
5,854 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9708829e-05
5,916 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9486769e-05
5,929 Self-Organizing Data Containers 2022 CIDR 5.9439349e-05
5,974 Towards instance-optimized data systems 2021 VLDB 5.9305575e-05
6,209 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.8495489e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8382355e-05
6,595 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves 2023 VLDB 5.7413481e-05
6,598 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.7405915e-05
6,719 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6985717e-05
6,970 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.6311067e-05
7,245 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5761132e-05
7,564 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4955249e-05
7,598 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4871733e-05
8,153 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 5.3891786e-05
8,179 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3826446e-05
8,196 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.3794981e-05
8,384 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.3421754e-05
8,403 The Case for Learned In-Memory Joins 2023 VLDB 5.3389852e-05
8,414 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.3350162e-05
8,830 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2683285e-05
9,918 Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity 2023 VLDB 5.1103839e-05
10,002 BT-Tree: A Reinforcement Learning Based Index for Big Trajectory Data 2024 SIGMOD 5.0979044e-05
10,048 Adaptive Indexing of Objects with Spatial Extent 2023 VLDB 5.0899328e-05
10,100 Adaptive data transformations for QaaS 2025 CIDR 5.0789354e-05
10,168 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.0682654e-05
10,619 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.9793485e-05
10,656 LM-Tree: A Hybrid Learned Index for Similarity Search in Metric Spaces 2026 SIGMOD 4.9793485e-05
10,703 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.9793485e-05
11,113 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9793485e-05
11,727 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
2 R-Trees: A Dynamic Index Structure For Spatial Searching 1984 SIGMOD 0.001992968
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046284649
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041219077
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036684414
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030762995
145 Neo: A Learned Query Optimizer 2019 VLDB 0.0002908188
187 DB2 Design Advisor: Integrated Automatic Physical Database Design 2004 VLDB 0.0002592488
195 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025628849
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485024
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023358891
253 Database Cracking 2007 CIDR 0.00023042111
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019045544
430 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018409112
460 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017842695
472 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00017692264
692 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014741011
868 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013354403
944 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00012939697
1,036 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012377471
1,200 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011563303
1,836 Merging What's Cracked, Cracking What's Merged: Adaptive Indexing in Main-Memory Column-Stores 2011 VLDB 9.535551e-05
1,889 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 9.4273689e-05
2,288 Clay: Fine-Grained Adaptive Partitioning for General Database Schemas 2017 VLDB 8.6912082e-05
2,373 To Tune or not to Tune? A Lightweight Physical Design Alerter 2006 VLDB 8.5606392e-05
2,882 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.9116043e-05
3,081 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.6653727e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2986853e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2943981e-05
3,856 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.96934e-05
5,827 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB 5.979772e-05
Previous Page 1 / 1 Next

Semantically Similar Papers