DBScholar

Back to papers

Instance-Optimized Data Layouts for Cloud Analytics Workloads

Summary: Introducing MTO, an instance-optimized data-layout framework that jointly blocks across all tables in multi-table cloud workloads (star/snowflake schemas) to maximize block skipping. Leveraging sideways information from joins, it beats single-table layouts, with up to 93% fewer blocks accessed and 75% faster end-to-end queries on a commercial service. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6223
Venue
SIGMOD
Year
2021
Pagerank
7.8297746e-05
Overall Rank
3,035 | 79.18%
DOI
10.1145/3448016.3457270

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ding_sigmod21,
        title = {{Instance-Optimized Data Layouts for Cloud Analytics Workloads}},
        author = {Ding, Jialin and Minhas, Umar Farooq and Chandramouli, Badrish and Wang, Chi and Li, Yinan and Li, Ying and Kossmann, Donald and Gehrke, Johannes and Kraska, Tim},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457270},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457270},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,631 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010174628
4,553 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR 6.6346951e-05
5,805 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 6.0822211e-05
5,974 Towards instance-optimized data systems 2021 VLDB 6.0230488e-05
6,042 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9970052e-05
6,076 Self-Organizing Data Containers 2022 CIDR 5.9852895e-05
6,480 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.8669819e-05
6,602 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8246665e-05
7,465 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.6108826e-05
7,660 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5736132e-05
7,755 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.5519655e-05
7,846 The Holon Approach for Simultaneously Tuning Multiple Components in a Self-Driving Database Management System with Machine Learning via Synthesized Proto-Actions 2024 VLDB 5.5331459e-05
8,323 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4539294e-05
8,657 An Experimental Comparison of Tree-data Structures for Connectivity Queries on Fully-dynamic Undirected Graphs 2025 SIGMOD 5.3907647e-05
8,721 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD 5.3772617e-05
9,779 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2209769e-05
9,913 Adaptive data transformations for QaaS 2025 CIDR 5.1955087e-05
9,974 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.1845938e-05
10,066 Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data Meshes 2023 VLDB 5.1643809e-05
10,306 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.093636e-05
10,430 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 5.093636e-05
10,506 This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch! 2026 SIGMOD 5.093636e-05
10,518 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 5.093636e-05
10,672 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 5.093636e-05
11,274 Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines 2024 VLDB 5.093636e-05
11,357 Data Pipes: Declarative Control over Data Movement 2023 CIDR 5.093636e-05
11,466 Anser: Adaptive Information Sharing Framework of AnalyticDB 2023 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 37 of 37 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
5 Optimal Aggregation Algorithms for Middleware [Extended Abstract] 2001 PODS 0.0010828372
43 The Case for Learned Index Structures 2018 SIGMOD 0.00046060254
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035838391
86 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00035316107
126 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030779127
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
246 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023457421
401 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019092557
447 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018322593
461 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00018068441
471 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.0001793564
513 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017190574
568 SageDB: A Learned Database System 2019 CIDR 0.0001641553
697 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014888851
790 FITing-Tree: A Data-aware Index Structure 2019 SIGMOD 0.0001401445
873 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013481915
940 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00013081205
1,037 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012494928
1,044 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.0001244236
1,135 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00012032847
1,174 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011817414
1,362 Execution Strategies for SQL Subqueries 2007 SIGMOD 0.00011032204
1,418 LISA: A Learned Index Structure for Spatial Data 2020 SIGMOD 0.00010835539
1,616 The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models 2018 SIGMOD 0.00010213691
1,852 Automated Partitioning Design in Parallel Database Systems 2011 SIGMOD 9.6134443e-05
2,156 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 9.0635624e-05
2,213 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.9410226e-05
2,224 An Experimental Study of Bitmap Compression vs. Inverted List Compression 2017 SIGMOD 8.9183396e-05
2,499 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.4993549e-05
2,666 Supporting Table Partitioning By Reference in Oracle 2008 SIGMOD 8.2764713e-05
2,866 Optimal Column Layout for Hybrid Workloads 2019 VLDB 8.0175489e-05
3,051 Towards a Hands-Free Query Optimizer through Deep Learning 2019 CIDR 7.8121919e-05
3,106 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.7515666e-05
3,137 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.7204167e-05
3,777 Database Tuning Advisor for Microsoft SQL Server 2005: Demo 2005 SIGMOD 7.1347483e-05
4,456 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.692321e-05
5,743 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 6.1025457e-05
Previous Page 1 / 1 Next

Semantically Similar Papers