MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs
Summary: MRTuner: MapReduce optimizer using a Producer-Transporter-Consumer (PTC) model to capture parallelism tradeoffs. Jointly tunes ~20 interdependent parameters with an efficient search, delivering optimized plans and faster results on HiBench workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Juwei Shi (IBM)
- 2. Jia Zou (IBM)
- 3. Jiaheng Lu (Renmin University of China)
- 4. Zhao Cao (IBM)
- 5. Shiqiang Li (IBM)
- 6. Chen Wang (IBM)
BibTeX Citation
@article{shi_vldb14,
title = {{MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs}},
author = {Shi, Juwei and Zou, Jia and Lu, Jiaheng and Cao, Zhao and Li, Shiqiang and Wang, Chen},
journal = {PVLDB},
series = {{VLDB} '14},
volume = {7},
number = {13},
pages = {1319--1330},
doi = {10.14778/2733004.2733005},
url = {https://doi.org/10.14778/2733004.2733005},
year = {2014}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,699 | Black or White? How to Develop an AutoTuner for Memory-based Analytics | 2020 | SIGMOD | 9.8445322e-05 |
| 4,116 | Resource Elasticity for Large-Scale Machine Learning | 2015 | SIGMOD | 6.7961306e-05 |
| 4,288 | Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics | 2015 | VLDB | 6.6855423e-05 |
| 5,967 | Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems | 2019 | VLDB | 5.9324372e-05 |
| 7,386 | Lachesis: Automatic Partitioning for UDF-Centric Analytics | 2021 | VLDB | 5.538189e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 272 | An Overview of Query Optimization in Relational Systems | 1998 | PODS | 0.00022509573 |
| 753 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB | 0.00014237583 |
| 940 | Starfish: A Self-tuning System for Big Data Analytics | 2011 | CIDR | 0.00012964445 |
| 1,351 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD | 0.00010934347 |
| 2,282 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD | 8.6964781e-05 |
| 3,237 | Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs | 2013 | SIGMOD | 7.5017163e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,351 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD |
| 2 | 2,527 | Stubby: A Transformation-based Optimizer for MapReduce Workflows | 2012 | VLDB |
| 3 | 75 | Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters | 2007 | SIGMOD |
| 4 | 1,281 | Automatic Optimization for MapReduce Programs | 2011 | VLDB |
| 5 | 2,573 | Minimal MapReduce Algorithms | 2013 | SIGMOD |
| 6 | 823 | MRShare: Sharing Across Multiple Queries in MapReduce | 2010 | VLDB |
| 7 | 12,589 | Optimization Strategies for A/B Testing on HADOOP | 2013 | VLDB |
| 8 | 753 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB |
| 9 | 1,466 | The Performance of MapReduce: An In-depth Study | 2010 | VLDB |
| 10 | 3,216 | Multi-Query Optimization in MapReduce Framework | 2014 | VLDB |