Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems

Summary: Skew-aware automatic partitioning for shared-nothing OLTP; addresses data and access skew, stored-procedure routing, and replicated secondary indexes. Analytical cost model plus large-neighborhood search minimize distributed transactions and scale with schema and data, yielding up to 16x throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4574
Venue: SIGMOD
Year: 2012
Pagerank: 0.0001793564
Overall Rank: 471 | 96.78%
DOI: 10.1145/2213836.2213844

Incoming Non-self Citations Over Time

Authors

1. Andrew Pavlo (Brown University)
2. Carlo Curino (Yahoo)
3. Stan Zdonik (Brown University)

BibTeX Citation

@inproceedings{pavlo_sigmod12,
        title = {{Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems}},
        author = {Pavlo, Andrew and Curino, Carlo and Zdonik, Stan},
        series = {{SIGMOD} '12},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2213836.2213844},
        url = {https://dl.acm.org/doi/10.1145/2213836.2213844},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 71 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
473	Staring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores	2015	VLDB	0.00017900942
720	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014632914
764	To Join or Not to Join? Thinking Twice about Joins before Feature Selection	2016	SIGMOD	0.00014226652
841	Let’s Talk About Storage & Recovery Methods for Non-Volatile Memory Database Systems	2015	SIGMOD	0.00013677356
887	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013403455
976	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00012864533
1,135	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00012032847
1,344	An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management Systems	2021	VLDB	0.00011094717
1,345	The End of a Myth: Distributed Transactions Can Scale	2017	VLDB	0.00011090483
1,915	S-Store: Streaming Meets Transaction Processing	2015	VLDB	9.4884706e-05
1,926	An Evaluation of Distributed Concurrency Control	2017	VLDB	9.4705999e-05
1,961	Scalable Atomic Visibility with RAMP Transactions	2014	SIGMOD	9.4000927e-05
2,234	Design Principles for Scaling Multi-core OLTP Under High Contention	2016	SIGMOD	8.8937932e-05
2,363	Clay: Fine-Grained Adaptive Partitioning for General Database Schemas	2017	VLDB	8.6873235e-05
2,407	Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases	2015	SIGMOD	8.6184333e-05
2,419	Towards a Non-2PC Transaction Management in Distributed Database Systems	2016	SIGMOD	8.6054486e-05
2,499	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	8.4993549e-05
2,866	Optimal Column Layout for Hybrid Workloads	2019	VLDB	8.0175489e-05
2,998	Handling Highly Contended OLTP Workloads Using Fast Dynamic Partitioning	2020	SIGMOD	7.8727047e-05
3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	7.8297746e-05
3,087	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.7702906e-05
3,126	S-Store: A Streaming NewSQL System for Big Velocity Applications	2014	VLDB	7.7330792e-05
3,200	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	7.642132e-05
3,218	Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions	2014	VLDB	7.6312132e-05
3,238	SharPer: Sharding Permissioned Blockchains Over Network Clusters	2021	SIGMOD	7.6084417e-05
3,586	Make Your Database System Dream of Electric Sheep: Towards Self-Driving Operation	2021	VLDB	7.2834069e-05
3,661	Sundial: Harmonizing Concurrency Control and Caching in a Distributed OLTP Database Management System	2018	VLDB	7.2167755e-05
3,687	MaaT: Effective and scalable coordination of distributed transactions in the cloud	2014	VLDB	7.2019738e-05
3,860	Analyzing the Impact of System Architecture on the Scalability of OLTP Engines for High-Contention Workloads	2018	VLDB	7.0670192e-05
3,985	Transaction Healing: Scaling Optimistic Concurrency Control on Multicores	2016	SIGMOD	6.9738485e-05
4,096	Parallel Analytics as a Service	2013	SIGMOD	6.9057396e-05
4,119	Proteus: A Self-Designing Range Filter	2022	SIGMOD	6.8907395e-05
4,456	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	6.692321e-05
4,869	Epoch-based Commit and Replication in Distributed OLTP Databases	2021	VLDB	6.4709867e-05
5,122	A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew	2015	SIGMOD	6.3573169e-05
5,395	AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data	2015	VLDB	6.2331619e-05
5,497	JECB: a Join-Extension, Code-Based Approach to OLTP Data Partitioning	2014	SIGMOD	6.1973614e-05
5,725	Chiller: Contention-centric Transaction Execution and Data Partitioning for Modern Networks	2020	SIGMOD	6.108451e-05
5,739	Taurus MM: bringing multi-master to the cloud	2023	VLDB	6.1036095e-05
6,174	Is Scalable OLTP in the Cloud a Solved Problem? Analyzing Data Access for Distributed OLTP Architectures	2023	CIDR	5.9510389e-05
6,279	Fast and Effective Distribution-Key Recommendation for Amazon Redshift	2020	VLDB	5.9286872e-05
6,457	TrillionG: A Trillion-scale Synthetic Graph Generator using a Recursive Vector Model	2017	SIGMOD	5.8741671e-05
6,770	PolarDB-MP: A Multi-Primary Cloud-Native Database via Disaggregated Shared Memory	2024	SIGMOD	5.7783709e-05
6,831	Incremental Elasticity For Array Databases	2014	SIGMOD	5.7599208e-05
6,848	Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning	2021	SIGMOD	5.7550624e-05
7,012	Adaptive Hybrid Indexes	2022	SIGMOD	5.7262686e-05
7,049	MgCrab: Transaction Crabbing for Live Migration in Deterministic Database Systems	2019	VLDB	5.7177768e-05
7,159	Transaction Scheduling: From Conflicts to Runtime Conflicts	2023	SIGMOD	5.6857508e-05
7,334	Towards Optimal Transaction Scheduling	2024	VLDB	5.6425501e-05
7,585	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD	5.5912479e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
68	The End of an Architectural Era (It’s Time for a Complete Rewrite)	2007	VLDB	0.00038446206
83	H-Store: A High-Performance, Distributed Main Memory Transaction Processing System	2008	VLDB	0.00036185259
87	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035281619
126	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00030779127
156	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028636811
157	OLTP Through the Looking Glass, and What We Found There	2008	SIGMOD	0.0002863588
184	DB2 Design Advisor: Integrated Automatic Physical Database Design	2004	VLDB	0.00026256101
188	Data Placement In Bubba	1988	SIGMOD	0.00026126036
199	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00025612088
246	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00023457421
347	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00020651582
387	AutoAdmin "What-if" Index Analysis Utility	1998	SIGMOD	0.00019442332
773	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD	0.00014131021
811	A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins	1991	VLDB	0.00013859761
1,028	Generic Database Cost Models for Hierarchical Memory Systems	2002	VLDB	0.00012557617
1,266	Compressing SQL Workloads	2002	SIGMOD	0.00011412078
1,315	Fast Updates on Read-Optimized Databases Using Multi-Core CPUs	2012	VLDB	0.00011181796
1,831	On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems	2012	VLDB	9.6635729e-05
1,852	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	9.6134443e-05
2,613	A Performance Analysis of Alternative Multi-Attribute Declustering Strategies	1992	SIGMOD	8.3460281e-05
7,801	A Non-Uniform Data Fragmentation Strategy for Parallel Main-Memory Database Systems	1995	VLDB	5.542027e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,822	Resource Bricolage for Parallel Database Systems	2015	VLDB
2	6,547	Optimal Splitters for Temporal and Multi-version Databases	2013	SIGMOD
3	773	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD
4	1,657	Handling Data Skew in Parallel Joins in Shared-Nothing Systems	2008	SIGMOD
5	1,236	Handling Data Skew in Multiprocessor Database Computers Using Partition Tuning	1991	VLDB
6	3,200	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
7	1,637	On the Design and Scalability of Distributed Shared-Data Databases	2015	SIGMOD
8	246	Automating Physical Database Design in a Parallel Database	2002	SIGMOD
9	1,852	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	7,585	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD