Advanced Partitioning Techniques for Massively Distributed Computation

Summary: Advanced partitioning strategies for massively distributed computation, reducing shuffling bottlenecks. Integrated in Microsoft Scope, these strategies optimize repartitioning operator placement, yielding notable real-world performance gains. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4509
Venue: SIGMOD
Year: 2012
Pagerank: 6.4748133e-05
Overall Rank: 4,068 | 71.73%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,473	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011786148
1,608	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011169837
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05
6,278	The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward	2021	VLDB	5.1241654e-05
7,099	KEA: Tuning an Exabyte-Scale Data Infrastructure	2021	SIGMOD	4.8263529e-05
7,110	Wide Table Layout Optimization based on Column Ordering and Duplication	2017	SIGMOD	4.8228761e-05
7,127	Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning	2021	SIGMOD	4.8184276e-05
7,459	Lachesis: Automatic Partitioning for UDF-Centric Analytics	2021	VLDB	4.7199075e-05
7,778	Runtime Variation in Big Data Analytics	2023	SIGMOD	4.6491879e-05
8,005	Pangea: Monolithic Distributed Storage for Data Analytics	2019	VLDB	4.6044087e-05
9,335	Parallel Query Processing: To Separate Communication from Computation	2022	SIGMOD	4.351469e-05
11,162	Distributed Consistency Beyond Queries	2023	PODS	4.1905499e-05
11,984	Anti-Combining for MapReduce	2014	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0040465394
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024217964
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00084679526
109	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00048217028
113	Encapsulation of Parallelism in the Volcano Query Processing System	1990	SIGMOD	0.0004673401
904	Fundamental Techniques for Order Optimization	1996	SIGMOD	0.00015425636
909	Tenzing A SQL Implementation On The MapReduce Framework	2011	VLDB	0.0001540191
1,265	Jaql: A Scripting Language for Large Scale Semistructured Data Analysis	2011	VLDB	0.00012933537
2,999	A Combined Framework for Grouping and Order Optimization	2004	VLDB	7.7460195e-05
4,336	Avoiding Sorting and Grouping In Processing Queries	2003	VLDB	6.2716355e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
8,458	Topology-aware Parallel Data Processing: Models, Algorithms and Systems at Scale	2020	CIDR	4.5013189e-05
12,001	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1905499e-05
679	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD	0.00018211621
11,843	An Efficient MapReduce Cube Algorithm for Varied Data Distributions	2016	SIGMOD	4.1905499e-05
6,538	Data Partitioning for In-Memory Systems: Myths, Challenges, and Opportunities	2019	CIDR	5.0173391e-05
3,709	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8211506e-05
2,410	Automated Partitioning Design in Parallel Database Systems	2011	SIGMOD	8.8643562e-05
4,128	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	6.4214449e-05
4,226	Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE	2019	VLDB	6.3382156e-05
5,309	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5714729e-05