Automatic Optimization for MapReduce Programs

Summary: Manimal automatically analyzes MapReduce programs to expose data-aware optimizations without programmer hints. Detects selections, projections, and other DB-style optimizations in embedded Java code, delivering up to 1,121% speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10267
Venue: VLDB
Year: 2011
Pagerank: 0.0001285503
Overall Rank: 1,280 | 91.10%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
868	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015789681
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
1,022	DBSherlock: A Performance Diagnostic Tool for Transactional Databases	2016	SIGMOD	0.00014614917
1,534	PerfXplain: Debugging MapReduce Job Performance	2012	VLDB	0.00011468393
2,611	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4536967e-05
2,674	Minimal MapReduce Algorithms	2013	SIGMOD	8.3328645e-05
2,747	Stubby: A Transformation-based Optimizer for MapReduce Workflows	2012	VLDB	8.1828918e-05
2,946	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	7.8372441e-05
3,129	Scalable Big Graph Processing in MapReduce	2014	SIGMOD	7.5008242e-05
3,208	Column-Oriented Storage Techniques for MapReduce	2011	VLDB	7.3781897e-05
3,703	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8289978e-05
4,021	Parallel Algorithms for Constructing Range and Nearest-Neighbor Searching Data Structures	2016	PODS	6.5225987e-05
4,909	A Method for Optimizing Opaque Filter Queries	2020	SIGMOD	5.8338804e-05
5,105	Only Aggressive Elephants are Fast Elephants	2012	VLDB	5.694494e-05
6,483	Towards Unified Ad-hoc Data Processing	2014	SIGMOD	5.0456397e-05
9,375	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB	4.347384e-05
9,685	Streaming Space Complexity of Nearly All Functions of One Variable on Frequency Vectors	2016	PODS	4.3047774e-05
11,976	Anti-Combining for MapReduce	2014	SIGMOD	4.1945683e-05
12,065	ClouDiA: A Deployment Advisor for Public Clouds	2013	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
2	R-Trees: A Dynamic Index Structure For Spatial Searching	1984	SIGMOD	0.0032169493
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024183614
15	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD	0.0010654262
21	C-Store: A Column-oriented DBMS	2005	VLDB	0.00086087497
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073498298
52	Database Architecture Optimized for the new Bottleneck: Memory Access	1999	VLDB	0.00066474881
131	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0004370331
157	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040397359
202	LINQ: Reconciling Objects, Relations and XML in the .NET Framework	2006	SIGMOD	0.00034920912
413	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB	0.00023904409
794	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00016605103

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,677	Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications	2018	SIGMOD	6.0047822e-05
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
11,976	Anti-Combining for MapReduce	2014	SIGMOD	4.1945683e-05
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073498298
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
1,615	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00011132319
15	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD	0.0010654262
2,674	Minimal MapReduce Algorithms	2013	SIGMOD	8.3328645e-05
3,703	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8289978e-05
868	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015789681