DBScholar

Back to papers

Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads

Summary: Cross-industry analysis of six production MapReduce traces reveals interactive workloads dominated by many small, query-like jobs—not just large batch jobs—and invalidates assumptions about uniform access and diurnal regularity. Proposes a TCP-like benchmark. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hcd1d939dc74436d6
Venue
VLDB
Year
2012
Pagerank
0.00012163258
Overall Rank
1,073 | 92.79%
DOI
10.14778/2367502.2367516

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{chen_vldb12,
        title = {{Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads}},
        author = {Chen, Yanpei and Alspaugh, Sara and Katz, Randy},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {12},
        pages = {1802--1813},
        doi = {10.14778/2367502.2367516},
        url = {https://doi.org/10.14778/2367502.2367516},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
1,445 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010628379
1,945 An Evaluation of Distributed Concurrency Control 2017 VLDB 9.3239199e-05
2,125 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 9.0017828e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2911896e-05
4,009 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 6.8559236e-05
4,146 Parallel Analytics as a Service 2013 SIGMOD 6.7774377e-05
5,836 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9732317e-05
6,792 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 5.6794384e-05
6,960 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.6313571e-05
7,388 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.5355684e-05
8,171 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3826392e-05
9,199 Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases 2016 VLDB 5.2088173e-05
9,264 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.2032182e-05
9,830 Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms 2021 VLDB 5.1230071e-05
9,831 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 5.1230071e-05
9,933 Workload-Aware CPU Performance Scaling for Transactional Database Systems 2018 SIGMOD 5.1079647e-05
11,720 QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark 2023 SIGMOD 4.9769913e-05
12,384 The Case for Small Data Management 2015 CIDR 4.9769913e-05
12,405 Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach 2015 SIGMOD 4.9769913e-05
12,496 Thoth: Towards Managing a Multi-System Cluster 2014 VLDB 4.9769913e-05
12,554 Workload Management for Big Data Analytics 2013 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049821554
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.0004552807
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004314366
106 Quickly Generating Billion-Record Synthetic Databases 1994 SIGMOD 0.00033518428
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019471648
651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015123701
675 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00014880686
754 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014231311
1,282 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011208192
1,302 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.00011106173
1,688 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 9.860716e-05
3,158 Energy Management for MapReduce Clusters 2010 VLDB 7.5798726e-05
4,419 Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls 2007 VLDB 6.6057136e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,234 Operational Analytics Data Management Systems 2016 VLDB
2 7,847 Oracle In-Database Hadoop: When MapReduce Meets RDBMS 2012 SIGMOD
3 3,217 Multi-Query Optimization in MapReduce Framework 2014 VLDB
4 2,573 Minimal MapReduce Algorithms 2013 SIGMOD
5 1,466 The Performance of MapReduce: An In-depth Study 2010 VLDB
6 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 754 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB
8 120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB
9 2,285 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
10 43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD