ParaTimer: A Progress Indicator for MapReduce DAGs

Summary: ParaTimer is a DAG-aware progress estimator for MapReduce workflows, using critical-path analysis to predict remaining time across paths. It handles failures and skew with multiple scenario estimates; implemented in Pig and validated on a cluster. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4270
Venue: SIGMOD
Year: 2010
Pagerank: 0.00010618229
Overall Rank: 1,770 | 87.69%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
718	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.0001763106
884	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.00015654004
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
1,534	PerfXplain: Debugging MapReduce Job Performance	2012	VLDB	0.00011468393
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
2,674	Minimal MapReduce Algorithms	2013	SIGMOD	8.3328645e-05
4,802	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD	5.9114415e-05
5,688	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	5.3702808e-05
5,844	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.3030037e-05
6,345	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.1023048e-05
6,484	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.0453762e-05
7,913	Resource Bricolage for Parallel Database Systems	2015	VLDB	4.6180739e-05
8,401	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	4.5250912e-05
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05
11,949	Big Data Research: Will Industry Solve all the Problems?	2015	VLDB	4.1945683e-05
12,059	Workload Management for Big Data Analytics	2013	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024183614
14	Online Aggregation	1997	SIGMOD	0.0010801504
1,228	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00013164884
1,512	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.00011597041
2,111	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	9.5286436e-05
2,208	Clustera: An Integrated Computation And Data Management System	2008	VLDB	9.2873257e-05
4,245	A Disk-Based Join With Probabilistic Guarantees*	2005	SIGMOD	6.3272687e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073498298
11,882	Parallel Evaluation of Multi-Semi-Joins	2016	VLDB	4.1945683e-05
2,111	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	9.5286436e-05
1,228	Toward a Progress Indicator for Database Queries	2004	SIGMOD	0.00013164884
2,674	Minimal MapReduce Algorithms	2013	SIGMOD	8.3328645e-05
1,110	Parallel Evaluation of Conjunctive Queries	2011	PODS	0.00013968198
1,512	Estimating Progress of Execution for SQL Queries	2004	SIGMOD	0.00011597041
9,448	Cost-based Fault-tolerance for Parallel Data Processing	2015	SIGMOD	4.3401906e-05
8,401	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	4.5250912e-05
7,911	ParTime: Parallel Temporal Aggregation	2016	SIGMOD	4.6184028e-05