DBScholar

Back to papers

A Platform for Scalable One-Pass Analytics using MapReduce

Summary: Proposes a one-pass analytics platform that replaces MapReduce's sort-merge bottlenecks with in-memory hashing. Introduces a frequency-key technique for large key-state spaces, achieving up to 1000× fewer spills and continuous results in a Hadoop prototype. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4510
Venue
SIGMOD
Year
2011
Pagerank
8.8398946e-05
Overall Rank
2,265 | 84.47%
DOI
10.1145/1989323.1989426

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{li_sigmod11,
        title = {{A Platform for Scalable One-Pass Analytics using MapReduce}},
        author = {Li, Boduo and Mazur, Edward and Diao, Yanlei and McGregor, Andrew and Shenoy, Prashant},
        series = {{SIGMOD} '11},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1989323.1989426},
        url = {https://dl.acm.org/doi/10.1145/1989323.1989426},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
1,319 SkewTune: Mitigating Skew in MapReduce Applications 2012 SIGMOD 0.00011175005
1,534 Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series 2021 VLDB 0.00010464308
2,357 Muppet: MapReduce-Style Processing of Fast Data 2012 VLDB 8.7013171e-05
3,096 Early Accurate Results for Advanced Analytics on MapReduce 2012 VLDB 7.7629371e-05
5,083 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB 6.3701057e-05
5,214 OctopusFS: A Distributed File System with Tiered Storage Management 2017 SIGMOD 6.3129716e-05
5,476 Lifetime-Based Memory Management for Distributed Data Processing Systems 2016 VLDB 6.2052672e-05
5,676 Scalable Progressive Analytics on Big Data in the Cloud 2013 VLDB 6.1251441e-05
5,720 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 6.1092082e-05
7,546 MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs 2014 VLDB 5.6024593e-05
8,429 Building Highly-Optimized, Low-Latency Pipelines for Genomic Data Analysis 2015 CIDR 5.4263087e-05
9,369 Redoop Infrastructure for Recurring Big Data Queries 2014 VLDB 5.2774963e-05
9,640 Supporting Scalable Analytics with Latency Constraints 2015 VLDB 5.2434488e-05
11,994 Massively Parallel Processing of Whole Genome Sequence Data: An In-Depth Performance Study 2017 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010686205
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00046055057
52 GAMMA - A High Performance Dataflow Database Machine 1986 VLDB 0.00041107291
72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00037695852
127 The Design of the Borealis Stream Processing Engine 2005 CIDR 0.00030738755
801 Query Execution Techniques for Caching Expensive Methods 1996 SIGMOD 0.00013909408
1,436 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010797443
1,600 Space-optimal Heavy Hitters with Strong Error Bounds 2009 PODS 0.00010240222
1,665 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 0.00010069173
2,513 Tuple Routing Strategies for Distributed Eddies 2003 VLDB 8.48462e-05
7,840 From a Stream of Relational Queries to Distributed Stream Processing 2010 VLDB 5.5339505e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 3,163 Multi-Query Optimization in MapReduce Framework 2014 VLDB
2 660 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB
3 735 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB
4 44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD
5 2,539 Minimal MapReduce Algorithms 2013 SIGMOD
6 9,640 Supporting Scalable Analytics with Latency Constraints 2015 VLDB
7 1,054 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB
8 72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
9 120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB
10 1,436 The Performance of MapReduce: An In-depth Study 2010 VLDB