Toward Progress Indicators on Steroids for Big Data Systems
Summary: Proposes a 'predict–monitor–revise' paradigm to deliver continuously updated progress and completion-time predictions for big-data jobs, resilient to skew, resource contention, and failures. Advocates principled fusion of runtime traces, cost models, and telemetry to yield accurate, updatable indicators for schedulers and users. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Jiexing Li
- 2. Rimma V. Nehme
- 3. Jeffrey Naughton
Incoming Citations (Sorted by Pagerank)
Showing 3 of 3 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 5,844 | MIFO: A Query-Semantic Aware Resource Allocation Policy | 2019 | SIGMOD | 5.3030037e-05 |
| 6,345 | Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics | 2016 | SIGMOD | 5.1023048e-05 |
| 7,913 | Resource Bricolage for Parallel Database Systems | 2015 | VLDB | 4.6180739e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0024183614 |
| 1,228 | Toward a Progress Indicator for Database Queries | 2004 | SIGMOD | 0.00013164884 |
| 1,334 | SkewTune: Mitigating Skew in MapReduce Applications | 2012 | SIGMOD | 0.0001250413 |
| 1,770 | ParaTimer: A Progress Indicator for MapReduce DAGs | 2010 | SIGMOD | 0.00010618229 |
| 2,241 | Query Optimization in Microsoft SQL Server PDW | 2012 | SIGMOD | 9.2191212e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| Overall Rank | Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 5,941 | Big Graphs: Challenges and Opportunities | 2022 | VLDB | 5.2635446e-05 |
| 10,714 | Towards Designing Future-Proof Data Processing Systems | 2025 | VLDB | 4.1945683e-05 |
| 1,512 | Estimating Progress of Execution for SQL Queries | 2004 | SIGMOD | 0.00011597041 |
| 11,831 | Logical Aspects of Massively Parallel and Distributed Systems | 2016 | PODS | 4.1945683e-05 |
| 1,228 | Toward a Progress Indicator for Database Queries | 2004 | SIGMOD | 0.00013164884 |
| 6,136 | Scalable Progressive Analytics on Big Data in the Cloud | 2013 | VLDB | 5.1928748e-05 |
| 5,368 | Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing | 2022 | VLDB | 5.5457532e-05 |
| 2,111 | When Can We Trust Progress Estimators for SQL Queries? | 2005 | SIGMOD | 9.5286436e-05 |
| 6,484 | A Statistical Approach Towards Robust Progress Estimation | 2012 | VLDB | 5.0453762e-05 |
| 1,770 | ParaTimer: A Progress Indicator for MapReduce DAGs | 2010 | SIGMOD | 0.00010618229 |