DBScholar

Back to papers

Qd-tree: Learning Data Layouts for Big Data Analytics

Summary: qd-tree: learning-based data layouts route records to storage blocks, minimizing I/O for analytics. Two methods, greedy and deep RL, build the qd-tree, delivering large I/O speedups over blocking and near 2× data-skipping lower bound, with semantic block descriptions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6047
Venue
SIGMOD
Year
2020
Pagerank
0.00012032847
Overall Rank
1,135 | 92.22%
DOI
10.1145/3318464.3389770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{yang_sigmod20,
        title = {{Qd-tree: Learning Data Layouts for Big Data Analytics}},
        author = {Yang, Zongheng and Chandramouli, Badrish and Wang, Chi and Gehrke, Johannes and Li, Yinan and Minhas, Umar Farooq and Larson, Per-Åke and Kossmann, Donald and Acharya, Rajeev},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389770},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389770},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank Citing Paper Year Venue Pagerank
447 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018322593
513 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017190574
1,174 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011817414
1,337 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011117488
1,551 Updatable Learned Index with Precise Positions 2021 VLDB 0.00010381398
1,631 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010174628
1,840 Effectively Learning Spatial Indices 2020 VLDB 9.6404567e-05
2,806 Are Updatable Learned Indexes Ready? 2022 VLDB 8.1013097e-05
2,910 APEX: A High-Performance Learned Index on Persistent Memory 2022 VLDB 7.9700885e-05
3,035 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 7.8297746e-05
3,792 Learned Index: A Comprehensive Experimental Evaluation 2023 VLDB 7.1220982e-05
3,926 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 7.0128068e-05
4,751 The RLR-Tree: A Reinforcement Learning Based R-Tree for Spatial Data 2023 SIGMOD 6.5241784e-05
5,037 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 6.3914026e-05
5,148 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.3465986e-05
5,805 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 6.0822211e-05
5,974 Towards instance-optimized data systems 2021 VLDB 6.0230488e-05
6,042 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9970052e-05
6,076 Self-Organizing Data Containers 2022 CIDR 5.9852895e-05
6,459 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves 2023 VLDB 5.8727182e-05
6,480 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.8669819e-05
6,602 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8246665e-05
6,670 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.8074043e-05
6,848 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.7550624e-05
7,465 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.6108826e-05
7,660 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5736132e-05
8,003 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.5084586e-05
8,048 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.5003171e-05
8,234 The Case for Learned In-Memory Joins 2023 VLDB 5.460955e-05
8,323 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4539294e-05
8,465 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 5.4194578e-05
8,794 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.370464e-05
9,145 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.3150984e-05
9,779 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2209769e-05
9,887 Adaptive Indexing of Objects with Spatial Extent 2023 VLDB 5.2006273e-05
9,913 Adaptive data transformations for QaaS 2025 CIDR 5.1955087e-05
9,974 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.1845938e-05
10,306 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.093636e-05
10,430 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 5.093636e-05
10,469 LM-Tree: A Hybrid Learned Index for Similarity Search in Metric Spaces 2026 SIGMOD 5.093636e-05
10,518 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 5.093636e-05
10,672 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 5.093636e-05
11,193 BT-Tree: A Reinforcement Learning Based Index for Big Trajectory Data 2024 SIGMOD 5.093636e-05
11,413 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 5.093636e-05
11,475 Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity 2023 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
2 R-Trees: A Dynamic Index Structure For Spatial Searching 1984 SIGMOD 0.0020210012
43 The Case for Learned Index Structures 2018 SIGMOD 0.00046060254
66 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00038561587
86 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00035316107
126 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030779127
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
184 DB2 Design Advisor: Integrated Automatic Physical Database Design 2004 VLDB 0.00026256101
199 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025612088
227 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00023958508
246 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023457421
259 Database Cracking 2007 CIDR 0.00023119313
401 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019092557
447 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018322593
461 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00018068441
471 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.0001793564
697 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014888851
873 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013481915
940 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00013081205
1,044 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.0001244236
1,199 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011703966
1,811 Merging What's Cracked, Cracking What's Merged: Adaptive Indexing in Main-Memory Column-Stores 2011 VLDB 9.698026e-05
1,942 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 9.4451535e-05
2,363 Clay: Fine-Grained Adaptive Partitioning for General Database Schemas 2017 VLDB 8.6873235e-05
2,364 To Tune or not to Tune? A Lightweight Physical Design Alerter 2006 VLDB 8.6869645e-05
2,866 Optimal Column Layout for Hybrid Workloads 2019 VLDB 8.0175489e-05
3,106 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.7515666e-05
3,413 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.4326381e-05
3,466 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.3909785e-05
3,796 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 7.1198446e-05
5,715 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB 6.1105343e-05
Previous Page 1 / 1 Next

Semantically Similar Papers