Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems

Summary: Skew-aware automatic partitioning for shared-nothing OLTP; addresses data and access skew, stored-procedure routing, and replicated secondary indexes. Analytical cost model plus large-neighborhood search minimize distributed transactions and scale with schema and data, yielding up to 16x throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h2c8dd21a77923a2c
Venue: SIGMOD
Year: 2012
Pagerank: 0.00017692264
Overall Rank: 472 | 96.83%
DOI: 10.1145/2213836.2213844

Incoming Non-self Citations Over Time

Authors

1. Andrew Pavlo (Brown University)
2. Carlo Curino (Yahoo)
3. Stan Zdonik (Brown University)

BibTeX Citation

@inproceedings{pavlo_sigmod12,
        title = {{Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems}},
        author = {Pavlo, Andrew and Curino, Carlo and Zdonik, Stan},
        series = {{SIGMOD} '12},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2213836.2213844},
        url = {https://dl.acm.org/doi/10.1145/2213836.2213844},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 71 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
445	Staring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores	2015	VLDB	0.00018176701
728	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014414001
777	To Join or Not to Join? Thinking Twice about Joins before Feature Selection	2016	SIGMOD	0.00014054709
864	Let’s Talk About Storage & Recovery Methods for Non-Volatile Memory Database Systems	2015	SIGMOD	0.00013391824
890	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013247078
945	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00012939225
1,132	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011898257
1,289	An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management Systems	2021	VLDB	0.00011162479
1,339	The End of a Myth: Distributed Transactions Can Scale	2017	VLDB	0.00010975458
1,938	S-Store: Streaming Meets Transaction Processing	2015	VLDB	9.3342542e-05
1,943	An Evaluation of Distributed Concurrency Control	2017	VLDB	9.3283112e-05
1,947	Scalable Atomic Visibility with RAMP Transactions	2014	SIGMOD	9.3241479e-05
2,276	Design Principles for Scaling Multi-core OLTP Under High Contention	2016	SIGMOD	8.7087896e-05
2,288	Clay: Fine-Grained Adaptive Partitioning for General Database Schemas	2017	VLDB	8.6912082e-05
2,335	Towards a Non-2PC Transaction Management in Distributed Database Systems	2016	SIGMOD	8.6221031e-05
2,424	Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases	2015	SIGMOD	8.485975e-05
2,478	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	8.4079121e-05
2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0439015e-05
2,882	Optimal Column Layout for Hybrid Workloads	2019	VLDB	7.9116043e-05
3,047	Handling Highly Contended OLTP Workloads Using Fast Dynamic Partitioning	2020	SIGMOD	7.7124257e-05
3,058	Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions	2014	VLDB	7.6964255e-05
3,128	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.6151967e-05
3,159	S-Store: A Streaming NewSQL System for Big Velocity Applications	2014	VLDB	7.5808147e-05
3,215	SharPer: Sharding Permissioned Blockchains Over Network Clusters	2021	SIGMOD	7.5267892e-05
3,239	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	7.5007569e-05
3,590	Make Your Database System Dream of Electric Sheep: Towards Self-Driving Operation	2021	VLDB	7.1865343e-05
3,722	Sundial: Harmonizing Concurrency Control and Caching in a Distributed OLTP Database Management System	2018	VLDB	7.0713122e-05
3,749	MaaT: Effective and scalable coordination of distributed transactions in the cloud	2014	VLDB	7.0529124e-05
3,898	Analyzing the Impact of System Architecture on the Scalability of OLTP Engines for High-Contention Workloads	2018	VLDB	6.936402e-05
4,064	Transaction Healing: Scaling Optimistic Concurrency Control on Multicores	2016	SIGMOD	6.8228568e-05
4,146	Parallel Analytics as a Service	2013	SIGMOD	6.7806268e-05
4,197	Proteus: A Self-Designing Range Filter	2022	SIGMOD	6.7417716e-05
4,533	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	6.5565658e-05
4,820	Epoch-based Commit and Replication in Distributed OLTP Databases	2021	VLDB	6.3962005e-05
4,895	TrillionG: A Trillion-scale Synthetic Graph Generator using a Recursive Vector Model	2017	SIGMOD	6.3670408e-05
5,185	PolarDB-MP: A Multi-Primary Cloud-Native Database via Disaggregated Shared Memory	2024	SIGMOD	6.238732e-05
5,213	A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew	2015	SIGMOD	6.2250048e-05
5,314	Chiller: Contention-centric Transaction Execution and Data Partitioning for Modern Networks	2020	SIGMOD	6.1842459e-05
5,363	Taurus MM: bringing multi-master to the cloud	2023	VLDB	6.1608121e-05
5,526	AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data	2015	VLDB	6.0937354e-05
5,546	JECB: a Join-Extension, Code-Based Approach to OLTP Data Partitioning	2014	SIGMOD	6.0884923e-05
6,270	Is Scalable OLTP in the Cloud a Solved Problem? Analyzing Data Access for Distributed OLTP Architectures	2023	CIDR	5.8283805e-05
6,277	Fast and Effective Distribution-Key Recommendation for Amazon Redshift	2020	VLDB	5.8266146e-05
6,743	Don’t Look Back, Look into the Future: Prescient Data Partitioning and Migration for Deterministic Database Systems	2021	SIGMOD	5.6909253e-05
6,966	Incremental Elasticity For Array Databases	2014	SIGMOD	5.6327836e-05
6,970	Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning	2021	SIGMOD	5.6311067e-05
7,003	Towards Optimal Transaction Scheduling	2024	VLDB	5.6244707e-05
7,154	Adaptive Hybrid Indexes	2022	SIGMOD	5.597934e-05
7,179	MgCrab: Transaction Crabbing for Live Migration in Deterministic Database Systems	2019	VLDB	5.5930043e-05
7,280	Transaction Scheduling: From Conflicts to Runtime Conflicts	2023	SIGMOD	5.5671848e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
70	The End of an Architectural Era (It’s Time for a Complete Rewrite)	2007	VLDB	0.00037859131
80	H-Store: A High-Performance, Distributed Main Memory Transaction Processing System	2008	VLDB	0.00036364464
88	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035351639
123	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00030762995
151	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028672526
157	OLTP Through the Looking Glass, and What We Found There	2008	SIGMOD	0.00028317906
187	DB2 Design Advisor: Integrated Automatic Physical Database Design	2004	VLDB	0.0002592488
191	Data Placement In Bubba	1988	SIGMOD	0.00025700375
195	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00025628849
243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00023358891
322	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00021041865
378	AutoAdmin "What-if" Index Analysis Utility	1998	SIGMOD	0.00019549382
797	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD	0.00013922631
833	A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins	1991	VLDB	0.00013583955
1,041	Generic Database Cost Models for Hierarchical Memory Systems	2002	VLDB	0.00012356709
1,242	Compressing SQL Workloads	2002	SIGMOD	0.00011373611
1,335	Fast Updates on Read-Optimized Databases Using Multi-Core CPUs	2012	VLDB	0.0001099401
1,842	On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems	2012	VLDB	9.526552e-05
1,883	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	9.4391795e-05
2,651	A Performance Analysis of Alternative Multi-Attribute Declustering Strategies	1992	SIGMOD	8.173793e-05
7,943	A Non-Uniform Data Fragmentation Strategy for Parallel Main-Memory Database Systems	1995	VLDB	5.4216551e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,967	Resource Bricolage for Parallel Database Systems	2015	VLDB
2	6,557	Optimal Splitters for Temporal and Multi-version Databases	2013	SIGMOD
3	797	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD
4	1,670	Handling Data Skew in Parallel Joins in Shared-Nothing Systems	2008	SIGMOD
5	1,254	Handling Data Skew in Multiprocessor Database Computers Using Partition Tuning	1991	VLDB
6	3,239	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
7	1,583	On the Design and Scalability of Distributed Shared-Data Databases	2015	SIGMOD
8	243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD
9	1,883	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	7,706	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD