DBScholar

Back to papers

Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads

Summary: Cross-industry analysis of six production MapReduce traces reveals interactive workloads dominated by many small, query-like jobs—not just large batch jobs—and invalidates assumptions about uniform access and diurnal regularity. Proposes a TCP-like benchmark. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hcd1d939dc74436d6
Venue
VLDB
Year
2012
Pagerank
0.00012168947
Overall Rank
1,072 | 92.80%
DOI
10.14778/2367502.2367516

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{chen_vldb12,
        title = {{Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads}},
        author = {Chen, Yanpei and Alspaugh, Sara and Katz, Randy},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {12},
        pages = {1802--1813},
        doi = {10.14778/2367502.2367516},
        url = {https://doi.org/10.14778/2367502.2367516},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
1,444 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.0001063181
1,943 An Evaluation of Distributed Concurrency Control 2017 VLDB 9.3283112e-05
2,123 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 9.0060385e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2943981e-05
4,008 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 6.8591707e-05
4,146 Parallel Analytics as a Service 2013 SIGMOD 6.7806268e-05
5,834 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9759267e-05
6,786 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 5.6820666e-05
6,958 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.634024e-05
7,386 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.538189e-05
8,165 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3851885e-05
9,190 Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases 2016 VLDB 5.2112843e-05
9,254 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.2056825e-05
9,823 Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms 2021 VLDB 5.1254334e-05
9,824 Optimistic Recovery for Iterative Dataflows in Action 2015 SIGMOD 5.1254334e-05
9,926 Workload-Aware CPU Performance Scaling for Transactional Database Systems 2018 SIGMOD 5.1103839e-05
11,714 QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark 2023 SIGMOD 4.9793485e-05
12,378 The Case for Small Data Management 2015 CIDR 4.9793485e-05
12,399 Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach 2015 SIGMOD 4.9793485e-05
12,490 Thoth: Towards Managing a Multi-System Cluster 2014 VLDB 4.9793485e-05
12,548 Workload Management for Big Data Analytics 2013 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049839909
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045546775
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043160717
106 Quickly Generating Billion-Record Synthetic Databases 1994 SIGMOD 0.00033526937
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001948031
651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015130782
673 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.0001488755
753 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014237583
1,281 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011213384
1,302 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.00011111126
1,688 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 9.8645784e-05
3,157 Energy Management for MapReduce Clusters 2010 VLDB 7.5834595e-05
4,417 Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls 2007 VLDB 6.6088398e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,228 Operational Analytics Data Management Systems 2016 VLDB
2 7,843 Oracle In-Database Hadoop: When MapReduce Meets RDBMS 2012 SIGMOD
3 3,216 Multi-Query Optimization in MapReduce Framework 2014 VLDB
4 2,573 Minimal MapReduce Algorithms 2013 SIGMOD
5 1,466 The Performance of MapReduce: An In-depth Study 2010 VLDB
6 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 753 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB
8 120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB
9 2,282 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
10 43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD