DBScholar

Back to papers

Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads

Summary: Cross-industry analysis of six production MapReduce traces reveals interactive workloads dominated by many small, query-like jobs—not just large batch jobs—and invalidates assumptions about uniform access and diurnal regularity. Proposes a TCP-like benchmark. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hcd1d939dc74436d6
Venue
VLDB
Year
2012
Pagerank
0.00012131641
Overall Rank
1,074 | 92.81%
DOI
10.14778/2367502.2367516

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{chen_vldb12,
        title = {{Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads}},
        author = {Chen, Yanpei and Alspaugh, Sara and Katz, Randy},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {12},
        pages = {1802--1813},
        doi = {10.14778/2367502.2367516},
        url = {https://doi.org/10.14778/2367502.2367516},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,885 An Evaluation of Distributed Concurrency Control 2017 VLDB 9.4209865e-05
2,139 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 8.9729383e-05
3,456 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2673968e-05
4,024 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 6.8338558e-05
4,161 Parallel Analytics as a Service 2013 SIGMOD 6.7570102e-05
5,847 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9537345e-05
6,808 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 5.6608074e-05
6,981 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.6127553e-05
7,405 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.5172664e-05
8,191 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3648409e-05
9,219 Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases 2016 VLDB 5.191841e-05
9,288 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.1860131e-05
9,493 Workload-Aware CPU Performance Scaling for Transactional Database Systems 2018 SIGMOD 5.1546712e-05
9,863 Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms 2021 VLDB 5.1063146e-05
9,864 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 5.1063146e-05
11,766 QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark 2023 SIGMOD 4.9605343e-05
12,427 The Case for Small Data Management 2015 CIDR 4.9605343e-05
12,448 Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach 2015 SIGMOD 4.9605343e-05
12,539 Thoth: Towards Managing a Multi-System Cluster 2014 VLDB 4.9605343e-05
12,597 Workload Management for Big Data Analytics 2013 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045453255
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
106 Quickly Generating Billion-Record Synthetic Databases 1994 SIGMOD 0.00033563032
385 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019419661
655 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015076669
677 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00014835154
759 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014194746
1,286 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011187304
1,308 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.0001107127
1,691 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 9.838545e-05
3,164 Energy Management for MapReduce Clusters 2010 VLDB 7.5607087e-05
4,437 Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls 2007 VLDB 6.5845654e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,250 Operational Analytics Data Management Systems 2016 VLDB
2 7,864 Oracle In-Database Hadoop: When MapReduce Meets RDBMS 2012 SIGMOD
3 3,228 Multi-Query Optimization in MapReduce Framework 2014 VLDB
4 2,561 Minimal MapReduce Algorithms 2013 SIGMOD
5 1,470 The Performance of MapReduce: An In-depth Study 2010 VLDB
6 76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 759 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB
8 120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB
9 2,299 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
10 43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD