Database Paper Browser

Back to papers

SkewTune: Mitigating Skew in MapReduce Applications

Summary: SkewTune automatically mitigates MapReduce skew without extra user input, as a drop-in Hadoop extension. It uses idle-node detection to repartition a straggler's unprocessed data, preserves input order for concatenation-based output reconstruction, and incurs minimal overhead when skew is absent. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4510
Venue
SIGMOD
Year
2012
Pagerank
0.00012492978
Overall Rank
1,339 | 90.70%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
539 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00020615453
1,312 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.00012650678
2,714 Minimal MapReduce Algorithms 2013 SIGMOD 8.2426646e-05
4,623 A General and Parallel Platform for Mining Co-Movement Patterns over Large-scale Trajectories 2017 VLDB 6.0352004e-05
4,646 LocationSpark: A Distributed In-Memory Data Management System for Big Spatial Data 2016 VLDB 6.0176549e-05
5,541 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 5.4501856e-05
6,100 Scalable Progressive Analytics on Big Data in the Cloud 2013 VLDB 5.2064148e-05
6,135 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 5.1908958e-05
6,817 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 4.9110239e-05
7,056 SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning 2017 VLDB 4.8420027e-05
7,154 Submodularity of Distributed Join Computation 2018 SIGMOD 4.8107765e-05
7,298 MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs 2014 VLDB 4.7651301e-05
8,398 Toward Progress Indicators on Steroids for Big Data Systems 2013 CIDR 4.5207516e-05
8,985 SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory 2014 SIGMOD 4.4129993e-05
9,008 The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – 2021 SIGMOD 4.4065351e-05
9,800 Dalton: Learned Partitioning for Distributed Data Streams 2023 VLDB 4.2777144e-05
11,535 Fangorn: Adaptive Execution Framework for Heterogeneous Workloads on Shared Clusters 2021 VLDB 4.1905499e-05
11,699 An Experimental Evaluation of Garbage Collectors on Big Data Applications 2019 VLDB 4.1905499e-05
11,941 FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data 2015 VLDB 4.1905499e-05
11,957 Big Data Research: Will Industry Solve all the Problems? 2015 VLDB 4.1905499e-05
12,148 SkewTune in Action: Mitigating Skew in MapReduce Applications 2012 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
14 Online Aggregation 1997 SIGMOD 0.0010813443
408 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00023939456
548 Practical Skew Handling in Parallel Joins 1992 VLDB 0.00020369531
776 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00016765694
789 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00016602215
852 A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins 1991 VLDB 0.00015896035
1,048 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00014442178
1,114 Parallel Evaluation of Conjunctive Queries 2011 PODS 0.00013871948
1,362 Highly Available, Fault-Tolerant, Parallel Dataflows 2004 SIGMOD 0.00012380613
1,675 Adaptive Parallel Aggregation Algorithms 1995 SIGMOD 0.00010937908
2,213 Clustera: An Integrated Computation And Data Management System 2008 VLDB 9.2796992e-05
2,476 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6907971e-05
2,578 A Latency and Fault-Tolerance Optimizer for Online Parallel Query Plans 2011 SIGMOD 8.5060604e-05
3,896 Estimation of Query-Result Distribution and its Application in Parallel-Join Load Balancing 1996 VLDB 6.6526869e-05
5,576 Efficient outer join data skew handling in parallel DBMS 2009 VLDB 5.4251727e-05
12,148 SkewTune in Action: Mitigating Skew in MapReduce Applications 2012 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
6,212 Skew Handling Techniques in Sort-Merge Join 2002 SIGMOD 5.1499439e-05
7,298 MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs 2014 VLDB 4.7651301e-05
2,216 Skew in Parallel Query Processing 2014 PODS 9.2693784e-05
548 Practical Skew Handling in Parallel Joins 1992 VLDB 0.00020369531
11,805 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB 4.1905499e-05
11,843 An Efficient MapReduce Cube Algorithm for Varied Data Distributions 2016 SIGMOD 4.1905499e-05
8,985 SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory 2014 SIGMOD 4.4129993e-05
1,355 Handling Data Skew in Multiprocessor Database Computers Using Partition Tuning 1991 VLDB 0.00012417228
11,941 FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data 2015 VLDB 4.1905499e-05
12,148 SkewTune in Action: Mitigating Skew in MapReduce Applications 2012 VLDB 4.1905499e-05