Instance-Optimized Data Layouts for Cloud Analytics Workloads

Summary: Introducing MTO, an instance-optimized data-layout framework that jointly blocks across all tables in multi-table cloud workloads (star/snowflake schemas) to maximize block skipping. Leveraging sideways information from joins, it beats single-table layouts, with up to 93% fewer blocks accessed and 75% faster end-to-end queries on a commercial service. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6162
Venue: SIGMOD
Year: 2021
Pagerank: 6.7713324e-05
Overall Rank: 3,777 | 73.76%
DOI: 10.1145/3448016.3457270

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,321	High-Throughput Vector Similarity Search in Knowledge Graphs	2023	SIGMOD	9.0359336e-05
5,772	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	5.3313794e-05
6,237	Self-Organizing Data Containers	2022	CIDR	5.1371094e-05
6,274	Diva: Making MVCC Systems HTAP-Friendly	2022	SIGMOD	5.1268676e-05
6,298	Towards instance-optimized data systems	2021	VLDB	5.1182917e-05
6,461	Pando: Enhanced Data Skipping with Logical Data Partitioning	2023	VLDB	5.0479786e-05
6,788	Proteus: Autonomous Adaptive Storage for Mixed Workloads	2022	SIGMOD	4.9207259e-05
6,971	Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses	2024	SIGMOD	4.8738633e-05
7,994	Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD	2024	VLDB	4.607322e-05
8,003	The Holon Approach for Simultaneously Tuning Multiple Components in a Self-Driving Database Management System with Machine Learning via Synthesized Proto-Actions	2024	VLDB	4.6049527e-05
8,223	Automated Multidimensional Data Layouts in Amazon Redshift	2024	SIGMOD	4.5509217e-05
8,410	Pruning in Snowflake: Working Smarter, Not Harder	2025	SIGMOD	4.5154358e-05
8,434	SageDB: An Instance-Optimized Data Analytics System	2022	VLDB	4.5077955e-05
8,777	Accelerate Distributed Joins with Predicate Transfer	2025	SIGMOD	4.4492064e-05
9,640	An Experimental Comparison of Tree-data Structures for Connectivity Queries on Fully-dynamic Undirected Graphs	2025	SIGMOD	4.3067693e-05
9,762	Adaptive data transformations for QaaS	2025	CIDR	4.2815042e-05
9,826	PLATON: Top-down R-tree Packing with Learned Partition Policy	2023	SIGMOD	4.2710095e-05
9,916	Check Out the Big Brain on BRAD: Simplifying Cloud Data Processing with Learned Automated Data Meshes	2023	VLDB	4.2520778e-05
10,141	Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning	2026	SIGMOD	4.1905499e-05
10,217	This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch!	2026	SIGMOD	4.1905499e-05
10,230	Breaking the Isolation-Freshness Trade-off: Joint Adaptive Storage Optimization for HTAP Systems	2026	VLDB	4.1905499e-05
10,396	Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve	2025	SIGMOD	4.1905499e-05
10,938	Automated Clustering Recommendation With Database Zone Maps	2024	SIGMOD	4.1905499e-05
11,070	Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines	2024	VLDB	4.1905499e-05
11,154	Data Pipes: Declarative Control over Data Movement	2023	CIDR	4.1905499e-05
11,269	Anser: Adaptive Information Sharing Framework of AnalyticDB	2023	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 37 of 37 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
8	Optimal Aggregation Algorithms for Middleware [Extended Abstract]	2001	PODS	0.0015436578
101	The Case for Learned Index Structures	2018	SIGMOD	0.00049778866
183	Automatic Database Management System Tuning Through Large-scale Machine Learning	2017	SIGMOD	0.00036859633
203	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034868567
208	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00034478612
285	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00028978423
329	Neo: A Learned Query Optimizer	2019	VLDB	0.00027301488
679	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD	0.00018211621
704	Query-based Workload Forecasting for Self-Driving Database Management Systems	2018	SIGMOD	0.00017785557
752	Deep Unsupervised Cardinality Estimation	2020	VLDB	0.00017138049
796	SageDB: A Learned Database System	2019	CIDR	0.00016541749
819	ALEX: An Updatable Adaptive Learned Index	2020	SIGMOD	0.00016237497
905	NeuroCard: One Cardinality Estimator for All Tables	2021	VLDB	0.00015423174
1,223	Enhancements to SQL Server Column Stores	2013	SIGMOD	0.00013192321
1,239	Selectivity Estimation for Range Predicates using Lightweight Models	2019	VLDB	0.00013091459
1,313	Cost-Based Optimization for Magic: Algebra and Implementation	1996	SIGMOD	0.00012629432
1,365	FITing-Tree: A Data-aware Index Structure	2019	SIGMOD	0.00012379754
1,464	Learning Multi-dimensional Indexes	2020	SIGMOD	0.0001184772
1,473	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011786148
1,581	Execution Strategies for SQL Subqueries	2007	SIGMOD	0.00011262795
1,608	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011169837
1,887	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00010201938
2,108	LISA: A Learned Index Structure for Spatial Data	2020	SIGMOD	9.5283642e-05
2,153	The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models	2018	SIGMOD	9.418541e-05
2,410	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	8.8643562e-05
2,777	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.1346418e-05
2,821	An Experimental Study of Bitmap Compression vs. Inverted List Compression	2017	SIGMOD	8.0639288e-05
2,868	Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations	2019	SIGMOD	7.9856878e-05
2,985	Supporting Table Partitioning By Reference in Oracle	2008	SIGMOD	7.7758625e-05
3,066	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	7.6255556e-05
3,482	Optimal Column Layout for Hybrid Workloads	2019	VLDB	7.0514808e-05
3,658	Towards a Hands-Free Query Optimizer through Deep Learning	2019	CIDR	6.8700949e-05
3,661	Database Tuning Advisor for Microsoft SQL Server 2005: Demo	2005	SIGMOD	6.8680306e-05
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05
3,923	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	6.6232068e-05
5,116	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	5.6805476e-05
6,481	Joins on Samples: A Theoretical Guide for Practitioners	2020	VLDB	5.039683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,482	Optimal Column Layout for Hybrid Workloads	2019	VLDB	7.0514808e-05
12,001	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1905499e-05
4,128	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	6.4214449e-05
6,799	Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters	2013	VLDB	4.9181295e-05
2,553	Towards Cost-Optimal Query Processing in the Cloud	2021	VLDB	8.5522099e-05
10,396	Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve	2025	SIGMOD	4.1905499e-05
8,410	Pruning in Snowflake: Working Smarter, Not Harder	2025	SIGMOD	4.5154358e-05
1,608	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011169837
5,309	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5714729e-05
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05