DBScholar

Back to papers

Robust Query Processing through Progressive Optimization

Summary: Progressive query optimization (POP) detects cardinality errors during execution and re-optimizes plans in a commercial DBMS. CHECK operators compute a validity range via a sensitivity analysis; when violated, re-optimization uses partial results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hafc60422fa7a7261
Venue
SIGMOD
Year
2004
Pagerank
0.00017691682
Overall Rank
471 | 96.85%
DOI
10.1145/1007568.1007642

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{markl_sigmod04,
        title = {{Robust Query Processing through Progressive Optimization}},
        author = {Markl, Volker and Raman, Vijayshankar and Simmen, David and Lohman, Guy and Pirahesh, Hamid and Cilimdzic, Miso},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007642},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007642},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 65 citing papers.

Rank Citing Paper Year Venue Pagerank
626 Adaptive Aggregation on Chip Multiprocessors 2007 VLDB 0.00015431379
689 Cardinality Estimation Done Right: Index-Based Join Sampling 2017 CIDR 0.00014725904
838 Proactive Re-Optimization 2005 SIGMOD 0.00013528646
1,261 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011289724
1,436 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010658836
1,896 CS2: A New Database Synopsis for Query Estimation 2013 SIGMOD 9.4010932e-05
1,987 Plan Bouquets: Query Processing without Selectivity Estimation 2014 SIGMOD 9.2323722e-05
2,228 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.7912743e-05
2,329 When Can We Trust Progress Estimators for SQL Queries? 2005 SIGMOD 8.6188984e-05
2,438 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.4532693e-05
2,829 G-CARE: A Framework for Performance Benchmarking of Cardinality Estimation Techniques for Subgraph Matching 2020 SIGMOD 7.9469964e-05
3,361 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB 7.3621595e-05
3,416 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.3046808e-05
3,531 Identifying Robust Plans through Plan Diagram Reduction 2008 VLDB 7.2065332e-05
3,550 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.1895215e-05
3,602 Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads 2017 VLDB 7.1572829e-05
3,779 Query Suspend and Resume 2007 SIGMOD 7.0032366e-05
3,785 Parallelizing Query Optimization 2008 VLDB 7.0012696e-05
4,069 Adaptive Query Processing in the Looking Glass 2005 CIDR 6.8080574e-05
4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.7973616e-05
4,122 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.7810085e-05
4,502 Xplus: A SQL-Tuning-Aware Query Optimizer 2010 VLDB 6.5572851e-05
4,817 Permutable Compiled Queries: Dynamically Adapting Compiled Queries without Recompiling 2021 VLDB 6.388743e-05
4,842 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.3734445e-05
4,876 Efficiently Approximating Query Optimizer Plan Diagrams 2008 VLDB 6.357646e-05
4,971 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.3209003e-05
5,044 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.2888728e-05
5,324 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.1645235e-05
5,367 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.1462017e-05
5,490 A Pay-As-You-Go Framework for Query Execution Feedback 2008 VLDB 6.0970166e-05
5,611 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.0498181e-05
5,670 Uncertainty Aware Query Execution Time Prediction 2014 VLDB 6.0266818e-05
5,673 Enabling Incremental Query Re-Optimization 2016 SIGMOD 6.0252485e-05
5,713 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 6.0090633e-05
5,782 POP/FED: Progressive Query Optimization for Federated Queries in DB2 2006 VLDB 5.9783002e-05
5,927 Inspector Joins 2005 VLDB 5.9281216e-05
5,999 On the Stability of Plan Costs and the Costs of Plan Stability 2010 VLDB 5.9034324e-05
6,038 Proactive Re-optimization with Rio 2005 SIGMOD 5.8901698e-05
6,672 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.6975871e-05
6,702 Impliance: A Next Generation Information Management Appliance 2007 CIDR 5.687616e-05
6,759 Cheap Data Analytics using Cold Storage Devices 2016 VLDB 5.6710776e-05
6,816 ROX: Run-time Optimization of XQueries 2009 SIGMOD 5.6593309e-05
7,269 Efficient Adaptive Detection of Complex Event Patterns 2018 VLDB 5.5534971e-05
7,325 Dynamic Plan Generation for Parameterized Queries 2009 SIGMOD 5.5383706e-05
7,397 Stop-and-Restart Style Execution for Long Running Decision Support Queries 2007 VLDB 5.5190903e-05
7,432 POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance 2024 VLDB 5.5133928e-05
7,509 Non-Invasive Progressive Optimization for In-Memory Databases 2016 VLDB 5.4916369e-05
7,619 On the Calculation of Optimality Ranges for Relational Query Execution Plans 2018 SIGMOD 5.4665491e-05
7,975 Robust Query Processing: Mission Possible 2020 VLDB 5.3985544e-05
8,035 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 5.3866645e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
37 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.00047654188
91 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.00034691614
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034050614
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028910892
291 Optimization of Dynamic Query Evaluation Plans 1994 SIGMOD 0.00021898776
426 Cost-based Query Scrambling for Initial Delays 1998 SIGMOD 0.00018432573
479 Dynamic Query Evaluation Plans 1989 SIGMOD 0.00017595584
646 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.00015166402
1,304 Parametric Query Optimization for Linear and Piecewise Linear Cost Functions 2002 VLDB 0.00011088983
3,009 Multiple Join Size Estimation by Virtual Domains (extended abstract) 1993 PODS 7.7439468e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 3,361 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB
2 5,223 Exact Cardinality Query Optimization with Bounded Execution Cost 2019 SIGMOD
3 7,619 On the Calculation of Optimality Ranges for Relational Query Execution Plans 2018 SIGMOD
4 10,446 Coresets for Robust Query Optimization 2026 PODS
5 6,128 Robustness Metrics for Relational Query Execution Plans 2018 VLDB
6 1,261 Sampling-Based Query Re-Optimization 2016 SIGMOD
7 7,509 Non-Invasive Progressive Optimization for In-Memory Databases 2016 VLDB
8 568 Towards a Robust Query Optimizer: A Principled and Practical Approach 2005 SIGMOD
9 8,208 Progressive Optimization in a Shared-Nothing Parallel Database 2007 SIGMOD
10 14,258 Progressive Optimization in Action 2004 VLDB