Toward a Progress Indicator for Database Queries

Summary: Proposes progress indicators for long-running SQL queries in RDBMS, addressing user-facing estimation challenges. Presents a technique suite enabling a simple yet useful progress indicator for many queries, with an initial PostgreSQL implementation. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3630
Venue: SIGMOD
Year: 2004
Pagerank: 0.00011999403
Overall Rank: 1,143 | 92.16%
DOI: 10.1145/1007568.1007658

Incoming Non-self Citations Over Time

Authors

1. Gang Luo (University of Wisconsin)
2. Jeffrey F. Naughton (University of Wisconsin)
3. Curt J. Ellmann (NCR Corporation)
4. Michael W. Watzke (NCR Corporation)

BibTeX Citation

@inproceedings{luo_sigmod04,
        title = {{Toward a Progress Indicator for Database Queries}},
        author = {Luo, Gang and Naughton, Jeffrey F. and Ellmann, Curt J. and Watzke, Michael W.},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007658},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007658},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
563	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.0001650812
624	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015683402
1,665	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	0.00010069173
2,270	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	8.8310714e-05
2,434	Efficient Skyline Computation over Low-Cardinality Domains	2007	VLDB	8.5839844e-05
2,822	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	8.0898536e-05
2,848	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	8.0538815e-05
3,482	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.3751635e-05
3,707	Query Suspend and Resume	2007	SIGMOD	7.1818056e-05
4,327	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.7574155e-05
5,537	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.1820087e-05
5,663	Early Hash Join: A Configurable Algorithm for the Efficient and Early Production of Join Results	2005	VLDB	6.1298345e-05
5,863	Supporting Time-Constrained SQL Queries in Oracle	2007	VLDB	6.0626421e-05
6,084	Efficient Detection of Empty-Result Queries	2006	VLDB	5.9830699e-05
6,138	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.9640712e-05
6,333	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.9094287e-05
6,375	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.8932222e-05
6,544	Properties of Inconsistency Measures for Databases	2021	SIGMOD	5.8461093e-05
6,939	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.7338637e-05
7,244	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.6638746e-05
7,822	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.5371287e-05
7,974	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.515738e-05
8,668	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	5.3882971e-05
8,984	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.3395569e-05
9,449	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB	5.2665098e-05
10,768	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00077458002
100	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034385207
131	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00030424509
151	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00029161879
289	Optimization of Dynamic Query Evaluation Plans	1994	SIGMOD	0.00022278876
365	STHoles: A Multidimensional Workload-Aware Histogram	2001	SIGMOD	0.00020041735
448	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00018292618
2,068	Scheduling Problems in Parallel Query Optimization	1995	PODS	9.2310451e-05
4,346	Estimating Compilation Time of a Query Optimizer	2003	SIGMOD	6.7510183e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,889	Provenance-based Data Skipping	2022	VLDB
2	6,084	Efficient Detection of Empty-Result Queries	2006	VLDB
3	6,651	Progressive Indexes: Indexing for Interactive Data Analysis	2019	VLDB
4	8,668	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR
5	1,892	Procedural Extensions of SQL: Understanding their usage in the wild	2021	VLDB
6	8,578	ProgressiveDB – Progressive Data Analytics as a Middleware	2019	VLDB
7	6,138	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
8	6,333	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
9	2,270	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,562	Estimating Progress of Execution for SQL Queries	2004	SIGMOD