Database Paper Browser

Back to papers

A Comparison of Approaches to Large-Scale Data Analysis

Summary: Compare MapReduce with parallel DBMSs for large-scale data analysis, tying MR to decades of parallel-SQL work. A 100-node benchmark finds DBMSs load/tune longer but run faster than MR; discusses causes and future-system implications. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4118
Venue
SIGMOD
Year
2009
Pagerank
0.00073570328
Overall Rank
42 | 99.72%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 72 citing papers.

Rank Citing Paper Year Venue Pagerank
66 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00061707583
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
139 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00042320525
158 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00040401371
167 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00039408116
408 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00023939456
442 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00023095823
539 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00020615453
789 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00016602215
931 An Evaluation of Alternative Architectures for Transaction Processing in the Cloud 2010 SIGMOD 0.00015228565
947 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00015112344
950 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00015100872
962 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00015003834
981 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB 0.00014866268
1,073 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00014255717
1,097 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014083973
1,199 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00013358019
1,281 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00012837411
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011137225
1,728 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 0.00010731422
1,797 epiC: an Extensible and Scalable System for Processing Big Data 2014 VLDB 0.00010502488
1,991 TIRAMOLA: Elastic NoSQL Provisioning Through a Cloud Management Platform 2012 SIGMOD 9.8422463e-05
2,072 HippogriffDB: Balancing I/O and GPU Bandwidth in Big Data Analytics 2016 VLDB 9.6300019e-05
2,326 Instant Loading for Main Memory Databases 2013 VLDB 9.0271498e-05
2,340 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 9.001663e-05
2,355 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.9727612e-05
2,441 CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop 2011 VLDB 8.8106295e-05
2,476 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6907971e-05
2,487 Shark: Fast Data Analysis Using Coarse-grained Distributed Memory 2012 SIGMOD 8.6609871e-05
2,518 Track Join: Distributed Joins with Minimal Network Traffic 2014 SIGMOD 8.6052941e-05
2,578 A Latency and Fault-Tolerance Optimizer for Online Parallel Query Plans 2011 SIGMOD 8.5060604e-05
2,754 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.1720428e-05
3,070 HAWQ: A Massively Parallel Processing SQL Engine in Hadoop 2014 SIGMOD 7.6157391e-05
3,186 Energy Management for MapReduce Clusters 2010 VLDB 7.4218249e-05
3,193 Column-Oriented Storage Techniques for MapReduce 2011 VLDB 7.4073719e-05
3,244 Can the Elephants Handle the NoSQL Onslaught? 2012 VLDB 7.3247981e-05
3,270 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.3013196e-05
3,348 Comparative Evaluation of Big-Data Systems on Scientific Image Analytics Workloads 2017 VLDB 7.1897861e-05
3,510 Integrating Hadoop and Parallel DBMS 2010 SIGMOD 7.0280199e-05
3,565 MISO: Souping Up Big Data Query Processing with a Multistore System 2014 SIGMOD 6.9627613e-05
3,660 CloudRAMSort: Fast and Efficient Large-Scale Distributed RAM Sort on Shared-Nothing Cluster 2012 SIGMOD 6.8683099e-05
4,570 Clydesdale: Structured Data Processing on Hadoop 2012 SIGMOD 6.0704524e-05
5,012 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 5.7543101e-05
5,110 Only Aggressive Elephants are Fast Elephants 2012 VLDB 5.6868273e-05
5,300 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 5.5751386e-05
5,334 Fast In-Memory SQL Analytics on Typed Graphs 2017 VLDB 5.5625443e-05
5,850 HadoopDB in Action: Building Real World Applications 2010 SIGMOD 5.3008257e-05
5,908 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 5.2731311e-05
6,065 Towards Energy-Efficient Database Cluster Design 2012 VLDB 5.2254299e-05
6,228 The Next Generation Operational Data Historian for IoT Based on Informix 2014 SIGMOD 5.1404266e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0024217964
21 GAMMA - A High Performance Dataflow Database Machine 1986 VLDB 0.00086104592
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00084679526
77 Multiprocessor Hash-Based Join Algorithms 1985 VLDB 0.00056488357
169 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00038967371
201 LINQ: Reconciling Objects, Relations and XML in the .NET Framework 2006 SIGMOD 0.00034903121
518 An Overview of The System Software of A Parallel Relational Database Machine GRACE 1986 VLDB 0.00021161322
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
6,065 Towards Energy-Efficient Database Cluster Design 2012 VLDB 5.2254299e-05
638 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00018810785
13,526 Database Systems Research on Data Mining 2010 SIGMOD -
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
3,709 Multi-Query Optimization in MapReduce Framework 2014 VLDB 6.8211506e-05
2,476 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6907971e-05
981 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB 0.00014866268
158 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00040401371
2,714 Minimal MapReduce Algorithms 2013 SIGMOD 8.2426646e-05
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011137225