ParaTimer: A Progress Indicator for MapReduce DAGs

Summary: ParaTimer is a DAG-aware progress estimator for MapReduce workflows, using critical-path analysis to predict remaining time across paths. It handles failures and skew with multiple scenario estimates; implemented in Pig and validated on a cluster. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4271
Venue: SIGMOD
Year: 2010
Pagerank: 0.00010608933
Overall Rank: 1,768 | 87.72%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
716	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00017623897
876	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.00015660534
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
1,533	PerfXplain: Debugging MapReduce Job Performance	2012	VLDB	0.00011462982
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6907971e-05
2,714	Minimal MapReduce Algorithms	2013	SIGMOD	8.2426646e-05
4,807	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD	5.9045148e-05
5,699	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	5.3655096e-05
5,855	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.297903e-05
6,341	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.0980049e-05
6,478	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.040535e-05
7,914	Resource Bricolage for Parallel Database Systems	2015	VLDB	4.6136905e-05
8,398	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	4.5207516e-05
9,505	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3300131e-05
11,957	Big Data Research: Will Industry Solve all the Problems?	2015	VLDB	4.1905499e-05
12,067	Workload Management for Big Data Analytics	2013	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024217964
14	Online Aggregation	1997	SIGMOD	0.0010813443
1,229	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00013153898
1,509	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.0001158945
2,113	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	9.5207583e-05
2,213	Clustera: An Integrated Computation And Data Management System	2008	VLDB	9.2796992e-05
4,244	A Disk-Based Join With Probabilistic Guarantees*	2005	SIGMOD	6.3228453e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073570328
11,890	Parallel Evaluation of Multi-Semi-Joins	2016	VLDB	4.1905499e-05
2,113	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	9.5207583e-05
1,229	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00013153898
2,714	Minimal MapReduce Algorithms	2013	SIGMOD	8.2426646e-05
1,114	Parallel Evaluation of Conjunctive Queries	2011	PODS	0.00013871948
1,509	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.0001158945
9,451	Cost-based Fault-tolerance for Parallel Data Processing	2015	SIGMOD	4.3364392e-05
8,398	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	4.5207516e-05
7,912	ParTime: Parallel Temporal Aggregation	2016	SIGMOD	4.6139725e-05