DBScholar

Back to papers

Qd-tree: Learning Data Layouts for Big Data Analytics

Summary: qd-tree: learning-based data layouts route records to storage blocks, minimizing I/O for analytics. Two methods, greedy and deep RL, build the qd-tree, delivering large I/O speedups over blocking and near 2× data-skipping lower bound, with semantic block descriptions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44f80a71990639c4
Venue
SIGMOD
Year
2020
Pagerank
0.00011873466
Overall Rank
1,132 | 92.42%
DOI
10.1145/3318464.3389770

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{yang_sigmod20,
        title = {{Qd-tree: Learning Data Layouts for Big Data Analytics}},
        author = {Yang, Zongheng and Chandramouli, Badrish and Wang, Chi and Gehrke, Johannes and Li, Yinan and Minhas, Umar Farooq and Larson, Per-Åke and Kossmann, Donald and Acharya, Rajeev},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389770},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389770},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank Citing Paper Year Venue Pagerank
427 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018429918
508 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017108973
1,190 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011564169
1,238 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011375179
1,371 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010874981
1,529 Updatable Learned Index with Precise Positions 2021 VLDB 0.00010320909
1,884 Effectively Learning Spatial Indices 2020 VLDB 9.422145e-05
2,590 Are Updatable Learned Indexes Ready? 2022 VLDB 8.2368464e-05
2,772 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0148928e-05
2,870 APEX: A High-Performance Learned Index on Persistent Memory 2022 VLDB 7.9033232e-05
3,632 Learned Index: A Comprehensive Experimental Evaluation 2023 VLDB 7.1274345e-05
3,655 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 7.1137504e-05
4,373 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 6.6191786e-05
4,797 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.3978116e-05
4,879 The RLR-Tree: A Reinforcement Learning Based R-Tree for Spatial Data 2023 SIGMOD 6.3567479e-05
5,788 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9763511e-05
5,856 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9514226e-05
5,935 Self-Organizing Data Containers 2022 CIDR 5.9251217e-05
5,982 Towards instance-optimized data systems 2021 VLDB 5.9096991e-05
6,041 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.8894534e-05
6,250 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.818039e-05
6,429 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.7691021e-05
6,604 LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves 2023 VLDB 5.7196547e-05
6,730 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6801409e-05
6,977 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.6135617e-05
7,264 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5557256e-05
7,585 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4747603e-05
7,621 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4664683e-05
8,176 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 5.3688159e-05
8,201 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3623066e-05
8,219 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.359172e-05
8,407 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.3219903e-05
8,419 The Case for Learned In-Memory Joins 2023 VLDB 5.3198816e-05
8,439 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.3148581e-05
8,857 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2484224e-05
9,960 Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity 2023 VLDB 5.0910746e-05
10,042 BT-Tree: A Reinforcement Learning Based Index for Big Trajectory Data 2024 SIGMOD 5.0786422e-05
10,085 Adaptive Indexing of Objects with Spatial Extent 2023 VLDB 5.0707008e-05
10,139 Adaptive data transformations for QaaS 2025 CIDR 5.0597449e-05
10,206 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.0491152e-05
10,691 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.9605343e-05
10,728 LM-Tree: A Hybrid Learned Index for Similarity Search in Metric Spaces 2026 SIGMOD 4.9605343e-05
10,774 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.9605343e-05
11,183 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9605343e-05
11,777 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
2 R-Trees: A Dynamic Index Structure For Spatial Searching 1984 SIGMOD 0.0019892478
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046249672
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041439488
74 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00037164008
122 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030701814
142 Neo: A Learned Query Optimizer 2019 VLDB 0.00029114937
189 DB2 Design Advisor: Integrated Automatic Physical Database Design 2004 VLDB 0.00025846085
196 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025581936
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024446892
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023296011
253 Database Cracking 2007 CIDR 0.00023037921
405 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019020138
427 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018429918
458 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017870238
474 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00017638418
690 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014703258
870 Learning Multi-dimensional Indexes 2020 SIGMOD 0.0001332034
946 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00012911968
1,039 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012349128
1,188 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011580449
1,846 Merging What's Cracked, Cracking What's Merged: Adaptive Indexing in Main-Memory Column-Stores 2011 VLDB 9.5057831e-05
1,900 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 9.3926585e-05
2,304 Clay: Fine-Grained Adaptive Partitioning for General Database Schemas 2017 VLDB 8.6591761e-05
2,381 To Tune or not to Tune? A Lightweight Physical Design Alerter 2006 VLDB 8.5299827e-05
2,891 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.887378e-05
3,094 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.637515e-05
3,453 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2720027e-05
3,456 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2673968e-05
3,867 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.9438458e-05
5,839 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB 5.957817e-05
Previous Page 1 / 1 Next

Semantically Similar Papers