Estimating Progress of Execution for SQL Queries

Summary: Estimating SQL query execution progress. Proposes techniques that form a robust basis for actionable progress indicators; experimental validation in Microsoft SQL Server shows promising results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3631
Venue: SIGMOD
Year: 2004
Pagerank: 0.00010354429
Overall Rank: 1,562 | 89.29%
DOI: 10.1145/1007568.1007659

Incoming Non-self Citations Over Time

Authors

1. Surajit Chaudhuri (Microsoft)
2. Vivek Narasayya (Microsoft)
3. Ravishankar Ramamurthy (University of Wisconsin)

BibTeX Citation

@inproceedings{chaudhuri_sigmod04,
        title = {{Estimating Progress of Execution for SQL Queries}},
        author = {Chaudhuri, Surajit and Narasayya, Vivek and Ramamurthy, Ravishankar},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007659},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007659},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
624	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015683402
1,665	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	0.00010069173
2,822	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	8.0898536e-05
3,230	An Analytic Data Engine for Visualization in Tableau	2011	SIGMOD	7.6208919e-05
3,482	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.3751635e-05
4,327	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.7574155e-05
5,056	The Case for Data Visualization Management Systems	2014	VLDB	6.3823595e-05
5,537	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.1820087e-05
6,138	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.9640712e-05
6,333	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.9094287e-05
6,375	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.8932222e-05
6,939	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.7338637e-05
7,244	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.6638746e-05
7,822	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.5371287e-05
7,974	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.515738e-05
8,572	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.4102362e-05
8,984	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.3395569e-05
10,768	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00077458002
89	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.00035031529
100	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034385207
151	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00029161879
274	Balancing Histogram Optimality and Practicality for Query Result Size Estimation	1995	SIGMOD	0.00022645621
448	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00018292618

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,486	Visualizing the robustness of query execution	2009	CIDR
2	7,366	Non-Invasive Progressive Optimization for In-Memory Databases	2016	VLDB
3	5,365	A Pay-As-You-Go Framework for Query Execution Feedback	2008	VLDB
4	12,760	Online Estimation For Subset-Based SQL Queries	2005	VLDB
5	682	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB
6	13,187	An Analytical Method for Estimating and Interpreting Query Time	1987	VLDB
7	6,333	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
8	6,138	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
9	2,270	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,143	Toward a Progress Indicator for Database Queries	2004	SIGMOD