MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs
Summary: MRTuner: MapReduce optimizer using a Producer-Transporter-Consumer (PTC) model to capture parallelism tradeoffs. Jointly tunes ~20 interdependent parameters with an efficient search, delivering optimized plans and faster results on HiBench workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Juwei Shi (IBM)
- 2. Jia Zou (IBM)
- 3. Jiaheng Lu (Renmin University of China)
- 4. Zhao Cao (IBM)
- 5. Shiqiang Li (IBM)
- 6. Chen Wang (IBM)
BibTeX Citation
@article{shi_vldb14,
title = {{MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs}},
author = {Shi, Juwei and Zou, Jia and Lu, Jiaheng and Cao, Zhao and Li, Shiqiang and Wang, Chen},
journal = {PVLDB},
series = {{VLDB} '14},
volume = {7},
number = {13},
pages = {1319--1330},
doi = {10.14778/2733004.2733005},
url = {https://doi.org/10.14778/2733004.2733005},
year = {2014}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,686 | Black or White? How to Develop an AutoTuner for Memory-based Analytics | 2020 | SIGMOD | 0.00010008686 |
| 4,049 | Resource Elasticity for Large-Scale Machine Learning | 2015 | SIGMOD | 6.9369379e-05 |
| 4,208 | Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics | 2015 | VLDB | 6.8319812e-05 |
| 5,865 | Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems | 2019 | VLDB | 6.0619534e-05 |
| 7,311 | Lachesis: Automatic Partitioning for UDF-Centric Analytics | 2021 | VLDB | 5.6491618e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 290 | An Overview of Query Optimization in Relational Systems | 1998 | PODS | 0.0002227038 |
| 735 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB | 0.00014522606 |
| 923 | Starfish: A Self-tuning System for Big Data Analytics | 2011 | CIDR | 0.00013189886 |
| 1,319 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD | 0.00011175005 |
| 2,265 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD | 8.8398946e-05 |
| 3,259 | Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs | 2013 | SIGMOD | 7.5892257e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,319 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD |
| 2 | 2,486 | Stubby: A Transformation-based Optimizer for MapReduce Workflows | 2012 | VLDB |
| 3 | 72 | Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters | 2007 | SIGMOD |
| 4 | 1,257 | Automatic Optimization for MapReduce Programs | 2011 | VLDB |
| 5 | 2,539 | Minimal MapReduce Algorithms | 2013 | SIGMOD |
| 6 | 803 | MRShare: Sharing Across Multiple Queries in MapReduce | 2010 | VLDB |
| 7 | 12,298 | Optimization Strategies for A/B Testing on HADOOP | 2013 | VLDB |
| 8 | 735 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB |
| 9 | 1,436 | The Performance of MapReduce: An In-depth Study | 2010 | VLDB |
| 10 | 3,163 | Multi-Query Optimization in MapReduce Framework | 2014 | VLDB |