DBScholar

Back to papers

Instance-Optimized Data Layouts for Cloud Analytics Workloads

Summary: Introducing MTO, an instance-optimized data-layout framework that jointly blocks across all tables in multi-table cloud workloads (star/snowflake schemas) to maximize block skipping. Leveraging sideways information from joins, it beats single-table layouts, with up to 93% fewer blocks accessed and 75% faster end-to-end queries on a commercial service. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0f827a5285c106e6
Venue
SIGMOD
Year
2021
Pagerank
8.0439015e-05
Overall Rank
2,765 | 81.42%
DOI
10.1145/3448016.3457270

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ding_sigmod21,
        title = {{Instance-Optimized Data Layouts for Cloud Analytics Workloads}},
        author = {Ding, Jialin and Minhas, Umar Farooq and Chandramouli, Badrish and Wang, Chi and Li, Yinan and Li, Ying and Kossmann, Donald and Gehrke, Johannes and Kraska, Tim},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457270},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457270},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 28 of 28 citing papers.

Rank Citing Paper Year Venue Pagerank
1,373 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.0001088854
4,369 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR 6.6315141e-05
5,854 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9708829e-05
5,916 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9486769e-05
5,929 Self-Organizing Data Containers 2022 CIDR 5.9439349e-05
5,974 Towards instance-optimized data systems 2021 VLDB 5.9305575e-05
6,209 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.8495489e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8382355e-05
6,598 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.7405915e-05
7,245 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5761132e-05
7,598 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4871733e-05
7,864 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.4367919e-05
7,977 The Holon Approach for Simultaneously Tuning Multiple Components in a Self-Driving Database Management System with Machine Learning via Synthesized Proto-Actions 2024 VLDB 5.4142519e-05
8,269 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD 5.3648571e-05
8,414 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.3350162e-05
8,819 An Experimental Comparison of Tree-data Structures for Connectivity Queries on Fully-dynamic Undirected Graphs 2025 SIGMOD 5.2698104e-05
8,830 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2683285e-05
9,115 Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data Meshes 2023 VLDB 5.2271833e-05
10,100 Adaptive data transformations for QaaS 2025 CIDR 5.0789354e-05
10,168 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.0682654e-05
10,290 This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch! 2026 SIGMOD 5.0431863e-05
10,619 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.9793485e-05
10,703 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.9793485e-05
10,968 LayoutPilot: A Lakehouse Physical Design Advisor 2026 VLDB 4.9793485e-05
11,113 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9793485e-05
11,601 Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines 2024 VLDB 4.9793485e-05
11,674 Data Pipes: Declarative Control over Data Movement 2023 CIDR 4.9793485e-05
11,777 Anser: Adaptive Information Sharing Framework of AnalyticDB 2023 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 37 of 37 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
5 Optimal Aggregation Algorithms for Middleware [Extended Abstract] 2001 PODS 0.0010679641
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046284649
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036684414
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035864347
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030762995
145 Neo: A Learned Query Optimizer 2019 VLDB 0.0002908188
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023358891
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019045544
430 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018409112
460 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017842695
472 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00017692264
512 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017050173
555 SageDB: A Learned Database System 2019 CIDR 0.00016506678
692 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014741011
779 FITing-Tree: A Data-aware Index Structure 2019 SIGMOD 0.00014030069
868 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013354403
944 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00012939697
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012401489
1,036 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012377471
1,132 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011898257
1,191 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011590153
1,378 Execution Strategies for SQL Subqueries 2007 SIGMOD 0.00010864448
1,446 LISA: A Learned Index Structure for Spatial Data 2020 SIGMOD 0.00010629222
1,605 The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models 2018 SIGMOD 0.00010093796
1,883 Automated Partitioning Design in Parallel Database Systems 2011 SIGMOD 9.4391795e-05
2,137 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9777553e-05
2,201 An Experimental Study of Bitmap Compression vs. Inverted List Compression 2017 SIGMOD 8.8726671e-05
2,238 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.7751619e-05
2,478 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.4079121e-05
2,704 Supporting Table Partitioning By Reference in Oracle 2008 SIGMOD 8.1149334e-05
2,882 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.9116043e-05
3,060 Towards a Hands-Free Query Optimizer through Deep Learning 2019 CIDR 7.6928239e-05
3,073 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6777283e-05
3,081 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.6653727e-05
3,844 Database Tuning Advisor for Microsoft SQL Server 2005: Demo 2005 SIGMOD 6.9871379e-05
4,533 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5565658e-05
5,831 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9782109e-05
Previous Page 1 / 1 Next

Semantically Similar Papers