Database Paper Browser

Back to papers

MRShare: Sharing Across Multiple Queries in MapReduce

Summary: MRShare merges related MapReduce jobs into groups and runs them as a single query to share work across jobs. Using a MapReduce-specific cost model, it derives an optimal grouping to maximize overlap, with a Hadoop prototype demonstrating substantial cost savings. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10100
Venue
VLDB
Year
2010
Pagerank
0.00015112344
Overall Rank
947 | 93.43%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
866 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00015771189
1,048 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00014442178
1,407 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012163413
1,921 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 0.00010085899
2,211 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.2823037e-05
2,690 Accelerating Recommendation System Training by Leveraging Popular Choices 2022 VLDB 8.2911466e-05
2,714 Minimal MapReduce Algorithms 2013 SIGMOD 8.2426646e-05
2,754 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.1720428e-05
2,855 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.013421e-05
2,998 Major Technical Advancements in Apache Hive 2014 SIGMOD 7.7477264e-05
3,068 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.6241861e-05
3,551 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 6.9776252e-05
3,565 MISO: Souping Up Big Data Query Processing with a Multistore System 2014 SIGMOD 6.9627613e-05
3,709 Multi-Query Optimization in MapReduce Framework 2014 VLDB 6.8211506e-05
4,171 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 6.3800823e-05
5,110 Only Aggressive Elephants are Fast Elephants 2012 VLDB 5.6868273e-05
6,079 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.2194019e-05
6,177 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB 5.1646971e-05
6,464 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.0471003e-05
7,347 Distributed Outlier Detection using Compressive Sensing 2015 SIGMOD 4.7502395e-05
7,690 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 4.6723821e-05
9,349 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 4.3497707e-05
11,843 An Efficient MapReduce Cube Algorithm for Varied Data Distributions 2016 SIGMOD 4.1905499e-05
11,890 Parallel Evaluation of Multi-Semi-Joins 2016 VLDB 4.1905499e-05
11,966 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 4.1905499e-05
11,984 Anti-Combining for MapReduce 2014 SIGMOD 4.1905499e-05
12,079 Mosquito: Another One Bites the Data Upload STream 2013 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0024217964
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00084679526
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073570328
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
89 Common Expression Analysis in Database Applications 1982 SIGMOD 0.00052299473
158 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00040401371
169 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00038967371
515 QPipe: A Simultaneously Pipelined Relational Query Engine 2005 SIGMOD 0.00021209491
776 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00016765694
826 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00016161625
1,027 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.0001458537
1,361 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.00012393719
1,430 A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses 2009 VLDB 0.0001202506
1,475 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011765071
3,508 Scheduling Shared Scans of Large Data Files 2008 VLDB 7.0293743e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
442 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00023095823
2,714 Minimal MapReduce Algorithms 2013 SIGMOD 8.2426646e-05
1,451 Online Aggregation for Large MapReduce Jobs 2011 VLDB 0.00011925842
3,068 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.6241861e-05
2,476 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6907971e-05
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
11,966 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 4.1905499e-05
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011137225
4,130 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 6.4205218e-05
3,709 Multi-Query Optimization in MapReduce Framework 2014 VLDB 6.8211506e-05