The Performance of MapReduce: An In-depth Study

Summary: A 100-node EC2 study isolates five Hadoop/MapReduce performance factors across parallelism levels. Careful tuning yields 2.5–3.5× speedups, narrowing the gap with parallel databases while retaining elastic, cost-conscious scalability. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: ha78d49573e09220a
Venue: VLDB
Year: 2010
Pagerank: 0.00010532106
Overall Rank: 1,470 | 90.15%
DOI: 10.14778/1920841.1920902

Incoming Non-self Citations Over Time

Authors

1. Dawei Jiang (National University of Singapore)
2. Beng Chin Ooi (National University of Singapore)
3. Lei Shi (National University of Singapore)
4. Sai Wu (National University of Singapore)

BibTeX Citation

@article{jiang_vldb10,
        title = {{The Performance of MapReduce: An In-depth Study}},
        author = {Jiang, Dawei and Ooi, Beng Chin and Shi, Lei and Wu, Sai},
        journal = {PVLDB},
        series = {{VLDB} '10},
        volume = {3},
        number = {1},
        pages = {472--483},
        doi = {10.14778/1920841.1920902},
        url = {https://doi.org/10.14778/1920841.1920902},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
759	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00014194746
944	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00012927479
1,706	PerfXplain: Debugging MapReduce Job Performance	2012	VLDB	9.804657e-05
2,183	Efficient Processing of k Nearest Neighbor Joins using MapReduce	2012	VLDB	8.8973287e-05
2,299	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6639611e-05
2,421	epiC: an Extensible and Scalable System for Processing Big Data	2014	VLDB	8.4793059e-05
2,699	CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop	2011	VLDB	8.100024e-05
2,912	HAWQ: A Massively Parallel Processing SQL Engine in Hadoop	2014	SIGMOD	7.8573961e-05
2,918	Column-Oriented Storage Techniques for MapReduce	2011	VLDB	7.8517976e-05
2,944	Efficient Multi-way Theta-Join Processing Using MapReduce	2012	VLDB	7.8126906e-05
3,017	Llama: Leveraging Columnar Storage for Scalable Join Processing in the MapReduce Framework	2011	SIGMOD	7.7319353e-05
3,347	Optimizing Analytic Data Flows for Multiple Execution Engines	2012	SIGMOD	7.3802385e-05
5,297	Only Aggressive Elephants are Fast Elephants	2012	VLDB	6.1773472e-05
5,664	Building Wavelet Histograms on Large Data in MapReduce	2012	VLDB	6.0293278e-05
5,979	Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems	2019	VLDB	5.910201e-05
6,092	Exploiting Soft and Hard Correlations in Big Data Query Optimization	2016	VLDB	5.8723624e-05
8,181	ScalaGiST: Scalable Generalized Search Trees for MapReduce Systems [Innovative Systems Paper]	2014	VLDB	5.3672299e-05
8,650	Piranha: Optimizing Short Jobs in Hadoop	2013	VLDB	5.2809021e-05
9,728	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB	5.1205326e-05
12,238	An Experimental Evaluation of Garbage Collectors on Big Data Applications	2019	VLDB	4.9605343e-05
12,525	DGFIndex for Smart Grid: Enhancing Hive with a Cost-Effective Multidimensional Range Index	2014	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
6	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0010494385
30	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00050364918
31	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00049707539
43	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00045453255
76	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD	0.00036932687
120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00031017868
635	Performance Tradeoffs in Read-Optimized Databases	2006	VLDB	0.00015334073
2,990	Clustera: An Integrated Computation And Data Management System	2008	VLDB	7.7609997e-05
3,547	Read-Optimized Databases, In Depth	2008	VLDB	7.1905227e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	759	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB
2	3,228	Multi-Query Optimization in MapReduce Framework	2014	VLDB
3	2,187	Efficient Processing of Data Warehousing Queries in a Split Execution Environment	2011	SIGMOD
4	9,728	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB
5	2,918	Column-Oriented Storage Techniques for MapReduce	2011	VLDB
6	2,561	Minimal MapReduce Algorithms	2013	SIGMOD
7	120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB
8	43	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD
9	2,299	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
10	677	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB