DBScholar

Back to papers

Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads

Summary: Cross-industry analysis of six production MapReduce traces reveals interactive workloads dominated by many small, query-like jobs—not just large batch jobs—and invalidates assumptions about uniform access and diurnal regularity. Proposes a TCP-like benchmark. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
10605
Venue
VLDB
Year
2012
Pagerank
0.00012390673
Overall Rank
1,054 | 92.78%
DOI
10.14778/2367502.2367516

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{chen_vldb12,
        title = {{Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads}},
        author = {Chen, Yanpei and Alspaugh, Sara and Katz, Randy},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {12},
        pages = {1802--1813},
        doi = {10.14778/2367502.2367516},
        url = {https://doi.org/10.14778/2367502.2367516},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
1,442 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010778486
1,926 An Evaluation of Distributed Concurrency Control 2017 VLDB 9.4705999e-05
2,094 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 9.1819738e-05
3,413 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.4326381e-05
4,096 Parallel Analytics as a Service 2013 SIGMOD 6.9057396e-05
5,083 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 6.3701057e-05
5,720 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 6.1092082e-05
6,736 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 5.787547e-05
6,822 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.7627651e-05
7,311 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.6491618e-05
8,001 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.508791e-05
9,039 Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases 2016 VLDB 5.3267474e-05
9,079 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.3251649e-05
9,669 Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms 2021 VLDB 5.2389261e-05
9,670 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 5.2389261e-05
9,746 Workload-Aware CPU Performance Scaling for Transactional Database Systems 2018 SIGMOD 5.227679e-05
11,399 QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark 2023 SIGMOD 5.093636e-05
12,085 The Case for Small Data Management 2015 CIDR 5.093636e-05
12,106 Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach 2015 SIGMOD 5.093636e-05
12,199 Thoth: Towards Managing a Multi-System Cluster 2014 VLDB 5.093636e-05
12,257 Workload Management for Big Data Analytics 2013 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00046055057
51 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004291425
105 Quickly Generating Billion-Record Synthetic Databases 1994 SIGMOD 0.00033877899
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
660 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00015198804
735 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014522606
1,257 Automatic Optimization for MapReduce Programs 2011 VLDB 0.000114432
1,324 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.00011149314
1,665 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 0.00010069173
3,104 Energy Management for MapReduce Clusters 2010 VLDB 7.7552953e-05
4,327 Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls 2007 VLDB 6.7574155e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,072 Operational Analytics Data Management Systems 2016 VLDB
2 7,689 Oracle In-Database Hadoop: When MapReduce Meets RDBMS 2012 SIGMOD
3 3,163 Multi-Query Optimization in MapReduce Framework 2014 VLDB
4 2,539 Minimal MapReduce Algorithms 2013 SIGMOD
5 1,436 The Performance of MapReduce: An In-depth Study 2010 VLDB
6 72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 735 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB
8 120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB
9 2,265 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
10 44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD