Automatic Optimization for MapReduce Programs

Summary: Manimal automatically analyzes MapReduce programs to expose data-aware optimizations without programmer hints. Detects selections, projections, and other DB-style optimizations in embedded Java code, delivering up to 1,121% speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10268
Venue: VLDB
Year: 2011
Pagerank: 0.00012837411
Overall Rank: 1,281 | 91.10%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
866	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015771189
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
1,024	DBSherlock: A Performance Diagnostic Tool for Transactional Databases	2016	SIGMOD	0.00014601525
1,533	PerfXplain: Debugging MapReduce Job Performance	2012	VLDB	0.00011462982
2,616	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4457819e-05
2,714	Minimal MapReduce Algorithms	2013	SIGMOD	8.2426646e-05
2,754	Stubby: A Transformation-based Optimizer for MapReduce Workflows	2012	VLDB	8.1720428e-05
3,000	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	7.7447724e-05
3,188	Scalable Big Graph Processing in MapReduce	2014	SIGMOD	7.4142307e-05
3,193	Column-Oriented Storage Techniques for MapReduce	2011	VLDB	7.4073719e-05
3,709	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8211506e-05
4,026	Parallel Algorithms for Constructing Range and Nearest-Neighbor Searching Data Structures	2016	PODS	6.5166769e-05
4,909	A Method for Optimizing Opaque Filter Queries	2020	SIGMOD	5.8354189e-05
5,110	Only Aggressive Elephants are Fast Elephants	2012	VLDB	5.6868273e-05
6,477	Towards Unified Ad-hoc Data Processing	2014	SIGMOD	5.0408007e-05
9,360	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB	4.3476444e-05
9,685	Streaming Space Complexity of Nearly All Functions of One Variable on Frequency Vectors	2016	PODS	4.3006524e-05
11,984	Anti-Combining for MapReduce	2014	SIGMOD	4.1905499e-05
12,073	ClouDiA: A Deployment Advisor for Public Clouds	2013	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
2	R-Trees: A Dynamic Index Structure For Spatial Searching	1984	SIGMOD	0.0032118946
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024217964
15	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD	0.0010668335
20	C-Store: A Column-oriented DBMS	2005	VLDB	0.00086163998
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073570328
52	Database Architecture Optimized for the new Bottleneck: Memory Access	1999	VLDB	0.00066322421
132	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00043697853
158	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040401371
201	LINQ: Reconciling Objects, Relations and XML in the .NET Framework	2006	SIGMOD	0.00034903121
408	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB	0.00023939456
789	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00016602215

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,676	Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications	2018	SIGMOD	5.9992323e-05
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073570328
11,984	Anti-Combining for MapReduce	2014	SIGMOD	4.1905499e-05
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6907971e-05
1,615	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00011137225
15	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD	0.0010668335
2,714	Minimal MapReduce Algorithms	2013	SIGMOD	8.2426646e-05
3,709	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8211506e-05
866	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015771189