DBScholar

Back to papers

MRShare: Sharing Across Multiple Queries in MapReduce

Summary: MRShare merges related MapReduce jobs into groups and runs them as a single query to share work across jobs. Using a MapReduce-specific cost model, it derives an optimal grouping to maximize overlap, with a Hadoop prototype demonstrating substantial cost savings. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
he2db0942238feff1
Venue
VLDB
Year
2010
Pagerank
0.00013600553
Overall Rank
825 | 94.48%
DOI
10.14778/1920841.1920905

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{nykiel_vldb10,
        title = {{MRShare: Sharing Across Multiple Queries in MapReduce}},
        author = {Nykiel, Tomasz and Potamias, Michalis and Mishra, Chaitanya and Kollios, George and Koudas, Nick},
        journal = {PVLDB},
        series = {{VLDB} '10},
        volume = {3},
        number = {1},
        pages = {494--505},
        doi = {10.14778/1920841.1920905},
        url = {https://doi.org/10.14778/1920841.1920905},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
759 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014194746
944 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00012927479
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,757 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7050769e-05
1,936 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3375824e-05
2,532 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.3132509e-05
2,561 Minimal MapReduce Algorithms 2013 SIGMOD 8.2743492e-05
2,692 Accelerating Recommendation System Training by Leveraging Popular Choices 2022 VLDB 8.1116599e-05
2,700 Major Technical Advancements in Apache Hive 2014 SIGMOD 8.096888e-05
2,720 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.0778267e-05
2,944 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.8126906e-05
3,043 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7045781e-05
3,228 Multi-Query Optimization in MapReduce Framework 2014 VLDB 7.4957341e-05
3,550 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.1895215e-05
3,848 MISO: Souping Up Big Data Query Processing with a Multistore System 2014 SIGMOD 6.9657736e-05
5,113 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 6.2569879e-05
5,297 Only Aggressive Elephants are Fast Elephants 2012 VLDB 6.1773472e-05
5,847 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9537345e-05
6,092 Exploiting Soft and Hard Correlations in Big Data Query Optimization 2016 VLDB 5.8723624e-05
6,234 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.825343e-05
7,976 Distributed Outlier Detection using Compressive Sensing 2015 SIGMOD 5.3981912e-05
9,746 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1178001e-05
12,380 An Efficient MapReduce Cube Algorithm for Varied Data Distributions 2016 SIGMOD 4.9605343e-05
12,424 Parallel Evaluation of Multi-Semi-Joins 2016 VLDB 4.9605343e-05
12,496 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 4.9605343e-05
12,514 Anti-Combining for MapReduce 2014 SIGMOD 4.9605343e-05
12,608 Mosquito: Another One Bites the Data Upload STream 2013 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010494385
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050364918
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045453255
76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00036932687
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031017868
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028524078
155 Common Expression Analysis in Database Applications 1982 SIGMOD 0.0002844242
390 QPipe: A Simultaneously Pipelined Relational Query Engine 2005 SIGMOD 0.00019232929
655 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015076669
707 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00014613324
768 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014096379
1,029 A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses 2009 VLDB 0.00012380835
1,137 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011856159
1,289 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.0001116552
3,325 Scheduling Shared Scans of Large Data Files 2008 VLDB 7.4110649e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 359 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD
2 2,561 Minimal MapReduce Algorithms 2013 SIGMOD
3 1,022 Online Aggregation for Large MapReduce Jobs 2011 VLDB
4 2,944 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB
5 2,299 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
6 76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 12,496 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB
8 1,470 The Performance of MapReduce: An In-depth Study 2010 VLDB
9 3,695 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD
10 3,228 Multi-Query Optimization in MapReduce Framework 2014 VLDB