Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads
Summary: First user-centered measurement of Hadoop use in scientific workloads across three clusters. Underuse of Hadoop features and tools coexists with diverse resource usage and interactive/iterative workloads, signaling strong need for automatic tuning and ecosystem optimizations. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Kai Ren (Carnegie Mellon University)
- 2. YongChul Kwon (Microsoft)
- 3. Magdalena Balazinska (University of Washington)
- 4. Bill Howe (University of Washington)
BibTeX Citation
@article{ren_vldb13,
title = {{Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads}},
author = {Ren, Kai and Kwon, YongChul and Balazinska, Magdalena and Howe, Bill},
journal = {PVLDB},
series = {{VLDB} '13},
volume = {6},
number = {10},
pages = {853--864},
doi = {10.14778/2536274.2536283},
url = {https://doi.org/10.14778/2536274.2536283},
year = {2013}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,442 | An Architecture for Compiling UDF-centric Workflows | 2015 | VLDB | 0.00010778486 |
| 2,592 | SQLShare: Results from a Multi-Year SQL-as-a-Service Experiment | 2016 | SIGMOD | 8.3657526e-05 |
| 3,635 | Changing the Face of Database Cloud Services with Personalized Service Level Agreements | 2015 | CIDR | 7.2343405e-05 |
| 5,720 | Opportunistic Physical Design for Big Data Analytics | 2014 | SIGMOD | 6.1092082e-05 |
| 7,673 | ROBUS: Fair Cache Allocation for Data-parallel Workloads | 2017 | SIGMOD | 5.5705944e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 8 of 8 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3 | Pregel: A System for Large-Scale Graph Processing | 2010 | SIGMOD | 0.0012250108 |
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0010686205 |
| 44 | A Comparison of Approaches to Large-Scale Data Analysis | 2009 | SIGMOD | 0.00046055057 |
| 735 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB | 0.00014522606 |
| 1,054 | Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads | 2012 | VLDB | 0.00012390673 |
| 1,319 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD | 0.00011175005 |
| 1,694 | PerfXplain: Debugging MapReduce Job Performance | 2012 | VLDB | 9.9953156e-05 |
| 2,077 | Generating Example Data for Dataflow Programs | 2009 | SIGMOD | 9.2085989e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,642 | CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop | 2011 | VLDB |
| 2 | 5,083 | Automating Distributed Tiered Storage Management in Cluster Computing | 2020 | VLDB |
| 3 | 9,510 | Efficient Big Data Processing in Hadoop MapReduce | 2012 | VLDB |
| 4 | 2,265 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD |
| 5 | 7,932 | Hone: “Scaling Down” Hadoop on Shared-Memory Systems | 2013 | VLDB |
| 6 | 4,595 | The "Big Data" Ecosystem at LinkedIn | 2013 | SIGMOD |
| 7 | 2,159 | Efficient Processing of Data Warehousing Queries in a Split Execution Environment | 2011 | SIGMOD |
| 8 | 660 | Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) | 2010 | VLDB |
| 9 | 1,436 | The Performance of MapReduce: An In-depth Study | 2010 | VLDB |
| 10 | 12,298 | Optimization Strategies for A/B Testing on HADOOP | 2013 | VLDB |