Estimating Progress of Execution for SQL Queries

Summary: Estimating SQL query execution progress. Proposes techniques that form a robust basis for actionable progress indicators; experimental validation in Microsoft SQL Server shows promising results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hacd3cf4fc59f2ca0
Venue: SIGMOD
Year: 2004
Pagerank: 0.0001014156
Overall Rank: 1,587 | 89.34%
DOI: 10.1145/1007568.1007659

Incoming Non-self Citations Over Time

Authors

1. Surajit Chaudhuri (Microsoft)
2. Vivek Narasayya (Microsoft)
3. Ravishankar Ramamurthy (University of Wisconsin)

BibTeX Citation

@inproceedings{chaudhuri_sigmod04,
        title = {{Estimating Progress of Execution for SQL Queries}},
        author = {Chaudhuri, Surajit and Narasayya, Vivek and Ramamurthy, Ravishankar},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007659},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007659},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
629	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015429949
1,688	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.8645784e-05
2,834	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9560627e-05
3,283	An Analytic Data Engine for Visualization in Tableau	2011	SIGMOD	7.4562243e-05
3,519	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.2389387e-05
4,417	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.6088398e-05
5,180	The Case for Data Visualization Management Systems	2014	VLDB	6.240722e-05
5,656	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.0488629e-05
6,241	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8381762e-05
6,435	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.7859508e-05
6,456	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7782179e-05
6,753	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.6904085e-05
7,376	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.540013e-05
7,460	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.5215755e-05
7,967	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.415894e-05
8,139	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.3920783e-05
9,133	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.2229655e-05
10,309	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.0386264e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076195956
91	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.0003475226
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034106982
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028981723
283	Balancing Histogram Optimality and Practicality for Query Result Size Estimation	1995	SIGMOD	0.00022214789
454	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00017962189

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,777	Visualizing the robustness of query execution	2009	CIDR
2	7,487	Non-Invasive Progressive Optimization for In-Memory Databases	2016	VLDB
3	5,470	A Pay-As-You-Go Framework for Query Execution Feedback	2008	VLDB
4	13,050	Online Estimation For Subset-Based SQL Queries	2005	VLDB
5	682	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB
6	13,477	An Analytical Method for Estimating and Interpreting Query Time	1987	VLDB
7	6,456	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
8	6,241	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
9	2,318	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,159	Toward a Progress Indicator for Database Queries	2004	SIGMOD