Database Paper Browser

Back to papers

Qd-tree: Learning Data Layouts for Big Data Analytics

Summary: qd-tree: learning-based data layouts route records to storage blocks, minimizing I/O for analytics. Two methods, greedy and deep RL, build the qd-tree, delivering large I/O speedups over blocking and near 2× data-skipping lower bound, with semantic block descriptions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5986
Venue
SIGMOD
Year
2020
Pagerank
0.00011169837
Overall Rank
1,608 | 88.83%
DOI
10.1145/3318464.3389770

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
819 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00016237497
905 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00015423174
1,404 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00012179714
1,887 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00010201938
2,321 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 9.0359336e-05
2,550 Updatable Learned Index with Precise Positions 2021 VLDB 8.5569576e-05
2,676 Effectively Learning Spatial Indices 2020 VLDB 8.326321e-05
3,777 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 6.7713324e-05
3,945 APEX: A High-Performance Learned Index on Persistent Memory 2022 VLDB 6.605467e-05
4,056 Are Updatable Learned Indexes Ready? 2022 VLDB 6.4905689e-05
4,730 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 5.9604983e-05
5,072 Learned Index: A Comprehensive Experimental Evaluation 2023 VLDB 5.7121108e-05
5,463 The RLR-Tree: A Reinforcement Learning Based R-Tree for Spatial Data 2023 SIGMOD 5.4920768e-05
5,571 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 5.4279553e-05
5,682 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 5.3752251e-05
6,237 Self-Organizing Data Containers 2022 CIDR 5.1371094e-05
6,274 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.1268676e-05
6,298 Towards instance-optimized data systems 2021 VLDB 5.1182917e-05
6,461 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.0479786e-05
6,788 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 4.9207259e-05
6,806 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves 2023 VLDB 4.917024e-05
6,962 Replicated Layout for In-Memory Database Systems 2022 VLDB 4.8771234e-05
6,971 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 4.8738633e-05
7,127 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 4.8184276e-05
8,089 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 4.5855593e-05
8,223 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 4.5509217e-05
8,410 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 4.5154358e-05
8,411 The Case for Learned In-Memory Joins 2023 VLDB 4.5151296e-05
8,434 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 4.5077955e-05
8,625 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 4.4784651e-05
8,636 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 4.4758336e-05
8,782 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 4.4478585e-05
9,762 Adaptive data transformations for QaaS 2025 CIDR 4.2815042e-05
9,769 Adaptive Indexing of Objects with Spatial Extent 2023 VLDB 4.2815042e-05
9,826 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 4.2710095e-05
10,141 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.1905499e-05
10,180 LM-Tree: A Hybrid Learned Index for Similarity Search in Metric Spaces 2026 SIGMOD 4.1905499e-05
10,230 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.1905499e-05
10,396 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.1905499e-05
10,767 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 4.1905499e-05
10,938 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 4.1905499e-05
10,983 BT-Tree: A Reinforcement Learning Based Index for Big Trajectory Data 2024 SIGMOD 4.1905499e-05
11,214 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.1905499e-05
11,278 Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity 2023 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
2 R-Trees: A Dynamic Index Structure For Spatial Searching 1984 SIGMOD 0.0032118946
101 The Case for Learned Index Structures 2018 SIGMOD 0.00049778866
167 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00039408116
183 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036859633
208 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00034478612
258 DB2 Design Advisor: Integrated Automatic Physical Database Design 2004 VLDB 0.00030196528
283 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00029024583
285 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00028978423
329 Neo: A Learned Query Optimizer 2019 VLDB 0.00027301488
367 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00025518228
407 Database Cracking 2007 CIDR 0.00023941779
679 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00018211621
704 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017785557
752 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00017138049
819 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00016237497
1,223 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00013192321
1,239 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00013091459
1,464 Learning Multi-dimensional Indexes 2020 SIGMOD 0.0001184772
1,473 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00011786148
1,697 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00010859294
2,361 Merging What’s Cracked, Cracking What’s Merged: Adaptive Indexing in Main-Memory Column-Stores 2011 VLDB 8.9648608e-05
2,606 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 8.4621503e-05
2,788 To Tune or not to Tune? A Lightweight Physical Design Alerter 2006 VLDB 8.121027e-05
3,006 Clay: Fine-Grained Adaptive Partitioning for General Database Schemas 2017 VLDB 7.7285127e-05
3,031 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 7.675808e-05
3,482 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.0514808e-05
3,731 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 6.8074069e-05
3,893 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 6.653922e-05
4,068 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 6.4748133e-05
5,612 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB 5.4104818e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
6,328 A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies 2024 VLDB 5.1034426e-05
3,777 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 6.7713324e-05
5,994 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 5.2367998e-05
8,961 T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees 2025 SIGMOD 4.4171776e-05
6,440 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD 5.0546781e-05
3,167 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 7.4561078e-05
5,012 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 5.7543101e-05
9,117 Deep Query Optimization 2019 SIGMOD 4.3885415e-05
4,004 QC-Trees: An Efficient Summary Structure for Semantic OLAP 2003 SIGMOD 6.5401186e-05
11,655 Query-Driven Learning for Next Generation Predictive Modeling & Analytics 2019 SIGMOD 4.1905499e-05