Estimating Progress of Execution for SQL Queries

Summary: Estimating SQL query execution progress. Proposes techniques that form a robust basis for actionable progress indicators; experimental validation in Microsoft SQL Server shows promising results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hacd3cf4fc59f2ca0
Venue: SIGMOD
Year: 2004
Pagerank: 0.00010119368
Overall Rank: 1,587 | 89.37%
DOI: 10.1145/1007568.1007659

Incoming Non-self Citations Over Time

Authors

1. Surajit Chaudhuri (Microsoft)
2. Vivek Narasayya (Microsoft)
3. Ravishankar Ramamurthy (University of Wisconsin)

BibTeX Citation

@inproceedings{chaudhuri_sigmod04,
        title = {{Estimating Progress of Execution for SQL Queries}},
        author = {Chaudhuri, Surajit and Narasayya, Vivek and Ramamurthy, Ravishankar},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007659},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007659},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
628	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015421836
1,691	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.838545e-05
2,828	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9476509e-05
3,296	An Analytic Data Engine for Visualization in Tableau	2011	SIGMOD	7.4283103e-05
3,384	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.3392425e-05
4,437	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.5845654e-05
5,203	The Case for Data Visualization Management Systems	2014	VLDB	6.2172569e-05
5,670	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.0266818e-05
6,243	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8220831e-05
6,447	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.7655496e-05
6,470	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7564896e-05
6,768	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.6693759e-05
7,397	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.5190903e-05
7,483	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.5007125e-05
7,987	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.3957073e-05
8,163	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.3717121e-05
9,154	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.2050937e-05
10,347	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.0195882e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076079812
91	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.00034691614
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034050614
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028910892
285	Balancing Histogram Optimality and Practicality for Query Result Size Estimation	1995	SIGMOD	0.00022143946
457	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00017915659

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,826	Visualizing the robustness of query execution	2009	CIDR
2	7,509	Non-Invasive Progressive Optimization for In-Memory Databases	2016	VLDB
3	5,490	A Pay-As-You-Go Framework for Query Execution Feedback	2008	VLDB
4	13,097	Online Estimation For Subset-Based SQL Queries	2005	VLDB
5	676	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB
6	13,524	An Analytical Method for Estimating and Interpreting Query Time	1987	VLDB
7	6,470	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
8	6,243	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
9	2,329	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,159	Toward a Progress Indicator for Database Queries	2004	SIGMOD