MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs
Summary: MRTuner: MapReduce optimizer using a Producer-Transporter-Consumer (PTC) model to capture parallelism tradeoffs. Jointly tunes ~20 interdependent parameters with an efficient search, delivering optimized plans and faster results on HiBench workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Juwei Shi (IBM)
- 2. Jia Zou (IBM)
- 3. Jiaheng Lu (Renmin University of China)
- 4. Zhao Cao (IBM)
- 5. Shiqiang Li (IBM)
- 6. Chen Wang (IBM)
BibTeX Citation
@article{shi_vldb14,
title = {{MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs}},
author = {Shi, Juwei and Zou, Jia and Lu, Jiaheng and Cao, Zhao and Li, Shiqiang and Wang, Chen},
journal = {PVLDB},
series = {{VLDB} '14},
volume = {7},
number = {13},
pages = {1319--1330},
doi = {10.14778/2733004.2733005},
url = {https://doi.org/10.14778/2733004.2733005},
year = {2014}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,700 | Black or White? How to Develop an AutoTuner for Memory-based Analytics | 2020 | SIGMOD | 9.8224761e-05 |
| 4,134 | Resource Elasticity for Large-Scale Machine Learning | 2015 | SIGMOD | 6.7721426e-05 |
| 4,303 | Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics | 2015 | VLDB | 6.6602891e-05 |
| 5,979 | Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems | 2019 | VLDB | 5.910201e-05 |
| 7,405 | Lachesis: Automatic Partitioning for UDF-Centric Analytics | 2021 | VLDB | 5.5172664e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 259 | An Overview of Query Optimization in Relational Systems | 1998 | PODS | 0.00022881075 |
| 759 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB | 0.00014194746 |
| 944 | Starfish: A Self-tuning System for Big Data Analytics | 2011 | CIDR | 0.00012927479 |
| 1,360 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD | 0.00010893993 |
| 2,299 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD | 8.6639611e-05 |
| 3,238 | Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs | 2013 | SIGMOD | 7.4847427e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,360 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD |
| 2 | 2,532 | Stubby: A Transformation-based Optimizer for MapReduce Workflows | 2012 | VLDB |
| 3 | 76 | Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters | 2007 | SIGMOD |
| 4 | 1,286 | Automatic Optimization for MapReduce Programs | 2011 | VLDB |
| 5 | 2,561 | Minimal MapReduce Algorithms | 2013 | SIGMOD |
| 6 | 825 | MRShare: Sharing Across Multiple Queries in MapReduce | 2010 | VLDB |
| 7 | 12,638 | Optimization Strategies for A/B Testing on HADOOP | 2013 | VLDB |
| 8 | 759 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB |
| 9 | 1,470 | The Performance of MapReduce: An In-depth Study | 2010 | VLDB |
| 10 | 3,228 | Multi-Query Optimization in MapReduce Framework | 2014 | VLDB |