Online Aggregation and Continuous Query support in MapReduce

Summary: MapReduce extended with operator-pipelining and online aggregation for early results, reducing batch latency. HOP enables continuous queries for event monitoring and stream processing, preserves Hadoop fault tolerance, and runs unmodified MapReduce programs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4389
Venue: SIGMOD
Year: 2010
Pagerank: 8.7642158e-05
Overall Rank: 2,312 | 84.14%
DOI: 10.1145/1807167.1807295

Incoming Non-self Citations Over Time

Authors

1. Tyson Condie (University of California Berkeley)
2. Neil Conway (University of California Berkeley)
3. Peter Alvaro (University of California Berkeley)
4. Joseph M. Hellerstein (University of California Berkeley)
5. John Gerth (Stanford University)
6. Justin Talbot (Stanford University)
7. Khaled Elmeleegy (Yahoo)
8. Russell Sears (Yahoo)

BibTeX Citation

@inproceedings{condie_sigmod10,
        title = {{Online Aggregation and Continuous Query support in MapReduce}},
        author = {Condie, Tyson and Conway, Neil and Alvaro, Peter and Hellerstein, Joseph M. and Gerth, John and Talbot, Justin and Elmeleegy, Khaled and Sears, Russell},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807295},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807295},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,492	BF-Tree: Approximate Tree Indexing	2014	VLDB	0.00010588267
1,736	A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data	2014	SIGMOD	9.8984415e-05
1,827	G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data	2015	SIGMOD	9.6690206e-05
3,096	Early Accurate Results for Advanced Analytics on MapReduce	2012	VLDB	7.7629371e-05
4,696	Error-bounded Sampling for Analytics on Big Sparse Data	2014	VLDB	6.557612e-05
4,918	Massive Scale-out of Expensive Continuous Queries	2011	VLDB	6.4469122e-05
5,522	Building Wavelet Histograms on Large Data in MapReduce	2012	VLDB	6.1871697e-05
6,122	iOLAP: Managing Uncertainty for Efficient Incremental OLAP	2016	SIGMOD	5.9687498e-05
6,473	Parallel Computation of Skyline and Reverse Skyline Queries Using MapReduce	2013	VLDB	5.8698599e-05
7,010	Analytics for the Real-Time Web	2011	VLDB	5.7265965e-05
7,795	Distributed Outlier Detection using Compressive Sensing	2015	SIGMOD	5.5429229e-05
8,608	One Size Does Not Fit All: A Bandit-Based Sampler Combination Framework with Theoretical Guarantees	2022	SIGMOD	5.4024561e-05
9,200	JENNER: Just-in-time Enrichment in Query Processing	2022	VLDB	5.3058708e-05
9,392	A Step Toward Deep Online Aggregation	2023	SIGMOD	5.2755515e-05
9,591	Sapprox: Enabling Efficient and Accurate Approximations on Sub-datasets with Distribution-aware Online Sampling	2017	VLDB	5.2518295e-05

Outgoing Citations (Sorted by Pagerank)

Showing 4 of 4 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
6	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0010686205
9	Online Aggregation	1997	SIGMOD	0.00077458002
32	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00050111008
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.00041071971

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	769	A Comparison of Join Algorithms for Log Processing in MapReduce	2010	SIGMOD
2	120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB
3	12,594	Ad-Hoc Data Processing in the Cloud	2008	VLDB
4	660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
5	72	Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters	2007	SIGMOD
6	9,369	Redoop Infrastructure for Recurring Big Data Queries	2014	VLDB
7	1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB
8	3,163	Multi-Query Optimization in MapReduce Framework	2014	VLDB
9	2,265	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
10	1,009	Online Aggregation for Large MapReduce Jobs	2011	VLDB