Toward a Progress Indicator for Database Queries

Summary: Proposes progress indicators for long-running SQL queries in RDBMS, addressing user-facing estimation challenges. Presents a technique suite enabling a simple yet useful progress indicator for many queries, with an initial PostgreSQL implementation. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h2bb978526b1c6b9e
Venue: SIGMOD
Year: 2004
Pagerank: 0.00011771949
Overall Rank: 1,159 | 92.21%
DOI: 10.1145/1007568.1007658

Incoming Non-self Citations Over Time

Authors

1. Gang Luo (University of Wisconsin)
2. Jeffrey F. Naughton (University of Wisconsin)
3. Curt J. Ellmann (NCR Corporation)
4. Michael W. Watzke (NCR Corporation)

BibTeX Citation

@inproceedings{luo_sigmod04,
        title = {{Toward a Progress Indicator for Database Queries}},
        author = {Luo, Gang and Naughton, Jeffrey F. and Ellmann, Curt J. and Watzke, Michael W.},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007658},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007658},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
560	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.00016403151
629	Performance Prediction for Concurrent Database Workloads	2011	SIGMOD	0.00015429949
1,688	ParaTimer: A Progress Indicator for MapReduce DAGs	2010	SIGMOD	9.8645784e-05
2,318	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD	8.6464837e-05
2,491	Efficient Skyline Computation over Low-Cardinality Domains	2007	VLDB	8.3921786e-05
2,815	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	7.9777435e-05
2,834	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9560627e-05
3,519	Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads	2013	VLDB	7.2389387e-05
3,772	Query Suspend and Resume	2007	SIGMOD	7.0297582e-05
4,417	Dynamic Workload Management for Very Large Data Warehouses - Juggling Feathers and Bowling Balls	2007	VLDB	6.6088398e-05
5,452	Early Hash Join: A Configurable Algorithm for the Efficient and Early Production of Join Results	2005	VLDB	6.1242445e-05
5,656	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.0488629e-05
5,864	Properties of Inconsistency Measures for Databases	2021	SIGMOD	5.9663944e-05
5,983	Supporting Time-Constrained SQL Queries in Oracle	2007	VLDB	5.926918e-05
6,208	Efficient Detection of Empty-Result Queries	2006	VLDB	5.8497045e-05
6,241	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD	5.8381762e-05
6,435	MIFO: A Query-Semantic Aware Resource Allocation Policy	2019	SIGMOD	5.7859508e-05
6,456	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB	5.7782179e-05
6,753	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.6904085e-05
7,376	Stop-and-Restart Style Execution for Long Running Decision Support Queries	2007	VLDB	5.540013e-05
7,967	Resource Bricolage for Parallel Database Systems	2015	VLDB	5.415894e-05
8,139	ConEx: A System for Monitoring Queries	2007	SIGMOD	5.3920783e-05
8,825	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR	5.268646e-05
9,133	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.2229655e-05
9,617	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB	5.1507816e-05
10,309	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	5.0386264e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076195956
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034106982
135	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00029866033
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028981723
289	Optimization of Dynamic Query Evaluation Plans	1994	SIGMOD	0.0002196543
371	STHoles: A Multidimensional Workload-Aware Histogram	2001	SIGMOD	0.00019829769
454	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00017962189
2,103	Scheduling Problems in Parallel Query Optimization	1995	PODS	9.0414685e-05
4,415	Estimating Compilation Time of a Query Optimizer	2003	SIGMOD	6.6094699e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,495	Provenance-based Data Skipping	2022	VLDB
2	6,208	Efficient Detection of Empty-Result Queries	2006	VLDB
3	6,746	Progressive Indexes: Indexing for Interactive Data Analysis	2019	VLDB
4	8,825	Toward Progress Indicators on Steroids for Big Data Systems	2013	CIDR
5	1,786	Procedural Extensions of SQL: Understanding their usage in the wild	2021	VLDB
6	8,744	ProgressiveDB – Progressive Data Analytics as a Middleware	2019	VLDB
7	6,241	Operator and Query Progress Estimation in Microsoft SQL Server Live Query Statistics	2016	SIGMOD
8	6,456	A Statistical Approach Towards Robust Progress Estimation	2012	VLDB
9	2,318	When Can We Trust Progress Estimators for SQL Queries?	2005	SIGMOD
10	1,587	Estimating Progress of Execution for SQL Queries	2004	SIGMOD