Efficient Big Data Processing in Hadoop MapReduce

Summary: Tutorial on efficient Hadoop MapReduce performance, covering optimization techniques, data layouts, and indexes to boost big-data processing. Contrasts with parallel DBMS, frames unresolved research questions, and outlines a three-part structure to bridge the performance gap to well-tuned databases. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10648
Venue: VLDB
Year: 2012
Pagerank: 5.2576928e-05
Overall Rank: 9,510 | 34.76%
DOI: 10.14778/2367502.2367562

Incoming Non-self Citations Over Time

Authors

1. Jens Dittrich (Saarland University)
2. Jorge-Arnulfo Quiané-Ruiz (Saarland University)

BibTeX Citation

@article{dittrich_vldb12,
        title = {{Efficient Big Data Processing in Hadoop MapReduce}},
        author = {Dittrich, Jens and Quiané-Ruiz, Jorge-Arnulfo},
        journal = {PVLDB},
        series = {{VLDB} '12},
        doi = {10.14778/2367502.2367562},
        url = {https://doi.org/10.14778/2367502.2367562},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,344	Towards General and Efficient Online Tuning for Spark	2023	VLDB	5.9060457e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
44	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00046055057
642	Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience	2009	VLDB	0.00015395331
660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00015198804
735	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00014522606
769	A Comparison of Join Algorithms for Log Processing in MapReduce	2010	SIGMOD	0.00014166872
843	Processing Theta-Joins using MapReduce*	2011	SIGMOD	0.00013666161
1,257	Automatic Optimization for MapReduce Programs	2011	VLDB	0.000114432
1,395	Column-oriented Database Systems	2009	VLDB	0.00010928358
1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00010797443
2,191	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.9780154e-05
2,849	Column-Oriented Storage Techniques for MapReduce	2011	VLDB	8.053191e-05
2,942	Llama: Leveraging Columnar Storage for Scalable Join Processing in the MapReduce Framework	2011	SIGMOD	7.9358593e-05
5,156	Only Aggressive Elephants are Fast Elephants	2012	VLDB	6.3410921e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	735	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB
2	2,265	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
3	2,849	Column-Oriented Storage Techniques for MapReduce	2011	VLDB
4	3,749	Integrating Hadoop and Parallel DBMS	2010	SIGMOD
5	120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB
6	6,147	HadoopDB in Action: Building Real World Applications	2010	SIGMOD
7	660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
8	1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB
9	12,257	Workload Management for Big Data Analytics	2013	SIGMOD
10	9,263	MapReduce Algorithms for Big Data Analysis	2012	VLDB