Estimating Progress of Execution for SQL Queries

Summary: Estimating SQL query execution progress. Proposes techniques that form a robust basis for actionable progress indicators; experimental validation in Microsoft SQL Server shows promising results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hacd3cf4fc59f2ca0
Venue: SIGMOD
Year: 2004
Pagerank: 0.00010137374
Overall Rank: 1,588 | 89.33%
DOI: 10.1145/1007568.1007659

Incoming Non-self Citations Over Time

Authors

1. Surajit Chaudhuri (Microsoft)
2. Vivek Narasayya (Microsoft)
3. Ravishankar Ramamurthy (University of Wisconsin)

BibTeX Citation

@inproceedings{chaudhuri_sigmod04,
        title = {{Estimating Progress of Execution for SQL Queries}},
        author = {Chaudhuri, Surajit and Narasayya, Vivek and Ramamurthy, Ravishankar},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007659},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007659},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
629	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015428007
1,688	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.860716e-05
2,833	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9539771e-05
3,283	An Analytic Data Engine for Visualization in Tableau	2011	SIGMOD	7.4529021e-05
3,519	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.2361015e-05
4,419	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.6057136e-05
5,181	The Case for Data Visualization Management Systems	2014	VLDB	6.2377699e-05
5,658	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.0460211e-05
6,243	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8357659e-05
6,437	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.7832118e-05
6,458	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7755054e-05
6,758	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.6877154e-05
7,378	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.537392e-05
7,464	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.5189616e-05
7,971	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.4133337e-05
8,146	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.3895274e-05
9,134	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.2223611e-05
10,319	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.0362412e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076265429
91	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.00034748721
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034099838
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028977821
284	Balancing Histogram Optimality and Practicality for Query Result Size Estimation	1995	SIGMOD	0.00022205848
454	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00017955913

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,783	Visualizing the robustness of query execution	2009	CIDR
2	7,492	Non-Invasive Progressive Optimization for In-Memory Databases	2016	VLDB
3	5,475	A Pay-As-You-Go Framework for Query Execution Feedback	2008	VLDB
4	13,056	Online Estimation For Subset-Based SQL Queries	2005	VLDB
5	682	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB
6	13,483	An Analytical Method for Estimating and Interpreting Query Time	1987	VLDB
7	6,458	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
8	6,243	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
9	2,320	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,158	Toward a Progress Indicator for Database Queries	2004	SIGMOD