Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems

Summary: Skew-aware automatic partitioning for shared-nothing OLTP; addresses data and access skew, stored-procedure routing, and replicated secondary indexes. Analytical cost model plus large-neighborhood search minimize distributed transactions and scale with schema and data, yielding up to 16x throughput. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h2c8dd21a77923a2c
Venue: SIGMOD
Year: 2012
Pagerank: 0.00017638418
Overall Rank: 474 | 96.83%
DOI: 10.1145/2213836.2213844

Incoming Non-self Citations Over Time

Authors

1. Andrew Pavlo (Brown University)
2. Carlo Curino (Yahoo)
3. Stan Zdonik (Brown University)

BibTeX Citation

@inproceedings{pavlo_sigmod12,
        title = {{Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems}},
        author = {Pavlo, Andrew and Curino, Carlo and Zdonik, Stan},
        series = {{SIGMOD} '12},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2213836.2213844},
        url = {https://dl.acm.org/doi/10.1145/2213836.2213844},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 71 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
447	Staring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores	2015	VLDB	0.00018126139
729	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014393711
783	To Join or Not to Join? Thinking Twice about Joins before Feature Selection	2016	SIGMOD	0.00014015599
865	Let’s Talk About Storage & Recovery Methods for Non-Volatile Memory Database Systems	2015	SIGMOD	0.00013346121
891	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013211469
928	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00013012601
1,132	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011873466
1,294	An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management Systems	2021	VLDB	0.00011129451
1,349	The End of a Myth: Distributed Transactions Can Scale	2017	VLDB	0.00010940559
1,885	An Evaluation of Distributed Concurrency Control	2017	VLDB	9.4209865e-05
1,951	S-Store: Streaming Meets Transaction Processing	2015	VLDB	9.302451e-05
1,952	Scalable Atomic Visibility with RAMP Transactions	2014	SIGMOD	9.2989778e-05
2,221	Design Principles for Scaling Multi-core OLTP Under High Contention	2016	SIGMOD	8.807697e-05
2,304	Clay: Fine-Grained Adaptive Partitioning for General Database Schemas	2017	VLDB	8.6591761e-05
2,347	Towards a Non-2PC Transaction Management in Distributed Database Systems	2016	SIGMOD	8.5919381e-05
2,435	Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases	2015	SIGMOD	8.4576994e-05
2,481	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	8.3862675e-05
2,772	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0148928e-05
2,891	Optimal Column Layout for Hybrid Workloads	2019	VLDB	7.887378e-05
3,045	Handling Highly Contended OLTP Workloads Using Fast Dynamic Partitioning	2020	SIGMOD	7.7044181e-05
3,069	Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions	2014	VLDB	7.6682775e-05
3,138	How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates	2016	SIGMOD	7.5866991e-05
3,174	S-Store: A Streaming NewSQL System for Big Velocity Applications	2014	VLDB	7.552969e-05
3,225	SharPer: Sharding Permissioned Blockchains Over Network Clusters	2021	SIGMOD	7.5026213e-05
3,258	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	7.4730157e-05
3,575	Make Your Database System Dream of Electric Sheep: Towards Self-Driving Operation	2021	VLDB	7.1769215e-05
3,729	Sundial: Harmonizing Concurrency Control and Caching in a Distributed OLTP Database Management System	2018	VLDB	7.0449074e-05
3,752	MaaT: Effective and scalable coordination of distributed transactions in the cloud	2014	VLDB	7.0324903e-05
3,905	Analyzing the Impact of System Architecture on the Scalability of OLTP Engines for High-Contention Workloads	2018	VLDB	6.9146292e-05
4,081	Transaction Healing: Scaling Optimistic Concurrency Control on Multicores	2016	SIGMOD	6.801179e-05
4,161	Parallel Analytics as a Service	2013	SIGMOD	6.7570102e-05
4,207	Proteus: A Self-Designing Range Filter	2022	SIGMOD	6.7226406e-05
4,550	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	6.5327021e-05
4,844	Epoch-based Commit and Replication in Distributed OLTP Databases	2021	VLDB	6.3720999e-05
4,922	TrillionG: A Trillion-scale Synthetic Graph Generator using a Recursive Vector Model	2017	SIGMOD	6.3430793e-05
5,208	PolarDB-MP: A Multi-Primary Cloud-Native Database via Disaggregated Shared Memory	2024	SIGMOD	6.215627e-05
5,236	A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew	2015	SIGMOD	6.2037372e-05
5,337	Chiller: Contention-centric Transaction Execution and Data Partitioning for Modern Networks	2020	SIGMOD	6.1613626e-05
5,382	Taurus MM: bringing multi-master to the cloud	2023	VLDB	6.138171e-05
5,554	AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data	2015	VLDB	6.0707181e-05
5,563	JECB: a Join-Extension, Code-Based Approach to OLTP Data Partitioning	2014	SIGMOD	6.0660277e-05
6,288	Is Scalable OLTP in the Cloud a Solved Problem? Analyzing Data Access for Distributed OLTP Architectures	2023	CIDR	5.8063583e-05
6,291	Fast and Effective Distribution-Key Recommendation for Amazon Redshift	2020	VLDB	5.8049232e-05
6,767	Don’t Look Back, Look into the Future: Prescient Data Partitioning and Migration for Deterministic Database Systems	2021	SIGMOD	5.6694268e-05
6,977	Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning	2021	SIGMOD	5.6135617e-05
6,978	Towards Optimal Transaction Scheduling	2024	VLDB	5.6130331e-05
6,987	Incremental Elasticity For Array Databases	2014	SIGMOD	5.6115324e-05
7,180	Adaptive Hybrid Indexes	2022	SIGMOD	5.5767825e-05
7,203	MgCrab: Transaction Crabbing for Live Migration in Deterministic Database Systems	2019	VLDB	5.5721192e-05
7,262	Transaction Scheduling: From Conflicts to Runtime Conflicts	2023	SIGMOD	5.5560872e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
70	The End of an Architectural Era (It’s Time for a Complete Rewrite)	2007	VLDB	0.00037761637
80	H-Store: A High-Performance, Distributed Main Memory Transaction Processing System	2008	VLDB	0.00036267455
89	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035265687
122	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00030701814
151	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028611216
157	OLTP Through the Looking Glass, and What We Found There	2008	SIGMOD	0.00028244257
189	DB2 Design Advisor: Integrated Automatic Physical Database Design	2004	VLDB	0.00025846085
194	Data Placement In Bubba	1988	SIGMOD	0.00025627096
196	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00025581936
243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00023296011
313	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00021288111
380	AutoAdmin "What-if" Index Analysis Utility	1998	SIGMOD	0.00019530546
797	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD	0.0001388084
836	A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins	1991	VLDB	0.00013534835
1,044	Generic Database Cost Models for Hierarchical Memory Systems	2002	VLDB	0.0001232071
1,246	Compressing SQL Workloads	2002	SIGMOD	0.00011355447
1,340	Fast Updates on Read-Optimized Databases Using Multi-Core CPUs	2012	VLDB	0.00010962559
1,840	On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems	2012	VLDB	9.5171028e-05
1,892	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	9.405261e-05
2,659	A Performance Analysis of Alternative Multi-Attribute Declustering Strategies	1992	SIGMOD	8.1438661e-05
7,958	A Non-Uniform Data Fragmentation Strategy for Parallel Main-Memory Database Systems	1995	VLDB	5.4014947e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,987	Resource Bricolage for Parallel Database Systems	2015	VLDB
2	6,569	Optimal Splitters for Temporal and Multi-version Databases	2013	SIGMOD
3	797	Low Overhead Concurrency Control for Partitioned Main Memory Databases	2010	SIGMOD
4	1,675	Handling Data Skew in Parallel Joins in Shared-Nothing Systems	2008	SIGMOD
5	1,259	Handling Data Skew in Multiprocessor Database Computers Using Partition Tuning	1991	VLDB
6	3,258	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
7	1,585	On the Design and Scalability of Distributed Shared-Data Databases	2015	SIGMOD
8	243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD
9	1,892	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD
10	7,725	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD