DBScholar

Back to papers

Instance-Optimized Data Layouts for Cloud Analytics Workloads

Summary: Introducing MTO, an instance-optimized data-layout framework that jointly blocks across all tables in multi-table cloud workloads (star/snowflake schemas) to maximize block skipping. Leveraging sideways information from joins, it beats single-table layouts, with up to 93% fewer blocks accessed and 75% faster end-to-end queries on a commercial service. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0f827a5285c106e6
Venue
SIGMOD
Year
2021
Pagerank
8.0148928e-05
Overall Rank
2,772 | 81.43%
DOI
10.1145/3448016.3457270
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{ding_sigmod21,
        title = {{Instance-Optimized Data Layouts for Cloud Analytics Workloads}},
        author = {Ding, Jialin and Minhas, Umar Farooq and Chandramouli, Badrish and Wang, Chi and Li, Yinan and Li, Ying and Kossmann, Donald and Gehrke, Johannes and Kraska, Tim},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457270},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457270},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 28 of 28 citing papers.

Rank Citing Paper Year Venue Pagerank
1,371 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010874981
4,396 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR 6.6072577e-05
5,788 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9763511e-05
5,856 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9514226e-05
5,935 Self-Organizing Data Containers 2022 CIDR 5.9251217e-05
5,982 Towards instance-optimized data systems 2021 VLDB 5.9096991e-05
6,041 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.8894534e-05
6,250 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.818039e-05
6,429 Proteus: Autonomous Adaptive Storage for Mixed Workloads 2022 SIGMOD 5.7691021e-05
7,264 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5557256e-05
7,363 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.5279826e-05
7,621 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 5.4664683e-05
7,997 The Holon Approach for Simultaneously Tuning Multiple Components in a Self-Driving Database Management System with Machine Learning via Synthesized Proto-Actions 2024 VLDB 5.3938336e-05
8,291 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD 5.3445863e-05
8,439 Workload-Aware Incremental Reclustering in Cloud Data Warehouses 2026 SIGMOD 5.3148581e-05
8,845 An Experimental Comparison of Tree-data Structures for Connectivity Queries on Fully-dynamic Undirected Graphs 2025 SIGMOD 5.2498988e-05
8,857 Automated Clustering Recommendation With Database Zone Maps 2024 SIGMOD 5.2484224e-05
9,143 Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data Meshes 2023 VLDB 5.2074327e-05
10,139 Adaptive data transformations for QaaS 2025 CIDR 5.0597449e-05
10,206 PLATON: Top-down R-tree Packing with Learned Partition Policy 2023 SIGMOD 5.0491152e-05
10,323 This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch! 2026 SIGMOD 5.0241309e-05
10,691 Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning 2026 SIGMOD 4.9605343e-05
10,774 Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems 2026 VLDB 4.9605343e-05
11,038 LayoutPilot: A Lakehouse Physical Design Advisor 2026 VLDB 4.9605343e-05
11,183 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9605343e-05
11,654 Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines 2024 VLDB 4.9605343e-05
11,726 Data Pipes: Declarative Control over Data Movement 2023 CIDR 4.9605343e-05
11,827 Anser: Adaptive Information Sharing Framework of AnalyticDB 2023 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 37 of 37 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
5 Optimal Aggregation Algorithms for Middleware [Extended Abstract] 2001 PODS 0.0010688884
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046249672
74 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00037164008
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035920657
122 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030701814
142 Neo: A Learned Query Optimizer 2019 VLDB 0.00029114937
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023296011
405 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019020138
427 ALEX: An Updatable Adaptive Learned Index 2020 SIGMOD 0.00018429918
458 Query-based Workload Forecasting for Self-Driving Database Management Systems 2018 SIGMOD 0.00017870238
474 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00017638418
508 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017108973
550 SageDB: A Learned Database System 2019 CIDR 0.00016525249
690 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014703258
774 FITing-Tree: A Data-aware Index Structure 2019 SIGMOD 0.00014063511
870 Learning Multi-dimensional Indexes 2020 SIGMOD 0.0001332034
946 Enhancements to SQL Server Column Stores 2013 SIGMOD 0.00012911968
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012376627
1,039 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012349128
1,132 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011873466
1,190 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011564169
1,381 Execution Strategies for SQL Subqueries 2007 SIGMOD 0.00010832197
1,445 LISA: A Learned Index Structure for Spatial Data 2020 SIGMOD 0.00010607118
1,611 The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models 2018 SIGMOD 0.00010066379
1,892 Automated Partitioning Design in Parallel Database Systems 2011 SIGMOD 9.405261e-05
2,017 An Experimental Study of Bitmap Compression vs. Inverted List Compression 2017 SIGMOD 9.169662e-05
2,147 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9595129e-05
2,249 Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations 2019 SIGMOD 8.7479608e-05
2,481 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.3862675e-05
2,714 Supporting Table Partitioning By Reference in Oracle 2008 SIGMOD 8.0855228e-05
2,891 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.887378e-05
3,062 Towards a Hands-Free Query Optimizer through Deep Learning 2019 CIDR 7.6809918e-05
3,081 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6515625e-05
3,094 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.637515e-05
3,852 Database Tuning Advisor for Microsoft SQL Server 2005: Demo 2005 SIGMOD 6.9614927e-05
4,550 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5327021e-05
5,841 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9569427e-05
Previous Page 1 / 1 Next

Semantically Similar Papers