Database Paper Browser

Back to papers

A Platform for Scalable One-Pass Analytics using MapReduce

Summary: Proposes a one-pass analytics platform that replaces MapReduce's sort-merge bottlenecks with in-memory hashing. Introduces a frequency-key technique for large key-state spaces, achieving up to 1000× fewer spills and continuous results in a Hadoop prototype. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4448
Venue
SIGMOD
Year
2011
Pagerank
8.6960139e-05
Overall Rank
2,476 | 82.78%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank Citing Paper Year Venue Pagerank
1,334 SkewTune: Mitigating Skew in MapReduce Applications 2012 SIGMOD 0.0001250413
1,634 Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series 2021 VLDB 0.00011058945
2,605 Muppet: MapReduce-Style Processing of Fast Data 2012 VLDB 8.4646171e-05
3,279 Early Accurate Results for Advanced Analytics on MapReduce 2012 VLDB 7.2855494e-05
4,861 OctopusFS: A Distributed File System with Tiered Storage Management 2017 SIGMOD 5.8708916e-05
5,793 Lifetime-Based Memory Management for Distributed Data Processing Systems 2016 VLDB 5.3258796e-05
6,075 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.223901e-05
6,104 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 5.2080102e-05
6,136 Scalable Progressive Analytics on Big Data in the Cloud 2013 VLDB 5.1928748e-05
7,304 MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs 2014 VLDB 4.7684491e-05
7,902 Building Highly-Optimized, Low-Latency Pipelines for Genomic Data Analysis 2015 CIDR 4.6215911e-05
9,266 Redoop Infrastructure for Recurring Big Data Queries 2014 VLDB 4.3667196e-05
9,504 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 4.3341665e-05
11,790 Massively Parallel Processing of Whole Genome Sequence Data: An In-Depth Performance Study 2017 SIGMOD 4.1945683e-05
11,894 Building Highly-Optimized, Low-Latency Pipelines for Genomic Data Analysis 2015 CIDR 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0024183614
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010654262
20 GAMMA - A High Performance Dataflow Database Machine 1986 VLDB 0.00086459551
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.0008456613
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073498298
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059533166
191 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00035738595
703 Query Execution Techniques for Caching Expensive Methods 1996 SIGMOD 0.00017916705
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011132319
1,629 Space-optimal Heavy Hitters with Strong Error Bounds 2009 PODS 0.00011085267
1,770 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 0.00010618229
2,814 Tuple Routing Strategies for Distributed Eddies 2003 VLDB 8.0749691e-05
7,736 From a Stream of Relational Queries to Distributed Stream Processing 2010 VLDB 4.664248e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
3,703 Multi-Query Optimization in MapReduce Framework 2014 VLDB 6.8289978e-05
794 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00016605103
868 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00015789681
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073498298
2,674 Minimal MapReduce Algorithms 2013 SIGMOD 8.3328645e-05
9,504 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 4.3341665e-05
979 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB 0.0001488055
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010654262
157 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00040397359
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011132319