DBScholar

Back to papers

A Comparison of Approaches to Large-Scale Data Analysis

Summary: Compare MapReduce with parallel DBMSs for large-scale data analysis, tying MR to decades of parallel-SQL work. A 100-node benchmark finds DBMSs load/tune longer but run faster than MR; discusses causes and future-system implications. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
ha21de992bbd6e4e8
Venue
SIGMOD
Year
2009
Pagerank
0.00045453255
Overall Rank
43 | 99.72%
DOI
10.1145/1559845.1559865

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{pavlo_sigmod09,
        title = {{A Comparison of Approaches to Large-Scale Data Analysis}},
        author = {Pavlo, Andrew and Paulson, Erik and Rasin, Alexander and Abadi, Daniel J. and DeWitt, David J. and Madden, Samuel and Stonebraker, Michael},
        series = {{SIGMOD} '09},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1559845.1559865},
        url = {https://dl.acm.org/doi/10.1145/1559845.1559865},
        year = {2009}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 71 citing papers.

Rank Citing Paper Year Venue Pagerank
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055523999
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041439488
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031017868
359 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00019963275
385 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019419661
436 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018274105
677 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00014835154
688 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014736145
799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00013839554
825 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013600553
867 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00013342302
893 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013199466
1,074 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB 0.00012131641
1,084 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00012086348
1,286 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011187304
1,331 An Evaluation of Alternative Architectures for Transaction Processing in the Cloud 2010 SIGMOD 0.00010997846
1,470 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010532106
1,537 HippogriffDB: Balancing I/O and GPU Bandwidth in Big Data Analytics 2016 VLDB 0.00010296073
1,707 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 9.8031942e-05
1,942 Instant Loading for Main Memory Databases 2013 VLDB 9.3133693e-05
2,002 Track Join: Distributed Joins with Minimal Network Traffic 2014 SIGMOD 9.189062e-05
2,187 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 8.8889656e-05
2,244 Shark: Fast Data Analysis Using Coarse-grained Distributed Memory 2012 SIGMOD 8.7648296e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,299 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6639611e-05
2,421 epiC: an Extensible and Scalable System for Processing Big Data 2014 VLDB 8.4793059e-05
2,532 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.3132509e-05
2,684 A Latency and Fault-Tolerance Optimizer for Online Parallel Query Plans 2011 SIGMOD 8.1185673e-05
2,699 CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop 2011 VLDB 8.100024e-05
2,912 HAWQ: A Massively Parallel Processing SQL Engine in Hadoop 2014 SIGMOD 7.8573961e-05
2,918 Column-Oriented Storage Techniques for MapReduce 2011 VLDB 7.8517976e-05
3,164 Energy Management for MapReduce Clusters 2010 VLDB 7.5607087e-05
3,403 CloudRAMSort: Fast and Efficient Large-Scale Distributed RAM Sort on Shared-Nothing Cluster 2012 SIGMOD 7.3213995e-05
3,416 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.3046808e-05
3,753 TIRAMOLA: Elastic NoSQL Provisioning Through a Cloud Management Platform 2012 SIGMOD 7.0296369e-05
3,831 Integrating Hadoop and Parallel DBMS 2010 SIGMOD 6.9765502e-05
3,848 MISO: Souping Up Big Data Query Processing with a Multistore System 2014 SIGMOD 6.9657736e-05
4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.7973616e-05
4,305 Can the Elephants Handle the NoSQL Onslaught? 2012 VLDB 6.6588577e-05
4,325 Comparative Evaluation of Big-Data Systems on Scientific Image Analytics Workloads 2017 VLDB 6.648427e-05
4,993 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3109925e-05
5,009 Fast In-Memory SQL Analytics on Typed Graphs 2017 VLDB 6.3030779e-05
5,297 Only Aggressive Elephants are Fast Elephants 2012 VLDB 6.1773472e-05
5,664 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 6.0293278e-05
5,876 Towards Energy-Efficient Database Cluster Design 2012 VLDB 5.945182e-05
5,972 Cheetah: Accelerating Database Queries with Switch Pruning 2020 SIGMOD 5.9114227e-05
5,979 Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems 2019 VLDB 5.910201e-05
6,292 HadoopDB in Action: Building Real World Applications 2010 SIGMOD 5.8048757e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers