DBScholar

Back to papers

Robust Query Processing through Progressive Optimization

Summary: Progressive query optimization (POP) detects cardinality errors during execution and re-optimizes plans in a commercial DBMS. CHECK operators compute a validity range via a sensitivity analysis; when violated, re-optimization uses partial results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
3619
Venue
SIGMOD
Year
2004
Pagerank
0.0001756877
Overall Rank
492 | 96.63%
DOI
10.1145/1007568.1007642

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{markl_sigmod04,
        title = {{Robust Query Processing through Progressive Optimization}},
        author = {Markl, Volker and Raman, Vijayshankar and Simmen, David and Lohman, Guy and Pirahesh, Hamid and Cilimdzic, Miso},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007642},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007642},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 62 citing papers.

Rank Citing Paper Year Venue Pagerank
632 Adaptive Aggregation on Chip Multiprocessors 2007 VLDB 0.00015575286
694 Cardinality Estimation Done Right: Index-Based Join Sampling 2017 CIDR 0.00014911698
829 Proactive Re-Optimization 2005 SIGMOD 0.00013769838
1,256 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011457194
1,468 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010686496
1,893 CS2: A New Database Synopsis for Query Estimation 2013 SIGMOD 9.5269935e-05
1,987 Plan Bouquets: Query Processing without Selectivity Estimation 2014 SIGMOD 9.3517129e-05
2,203 Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models 2017 VLDB 8.9610447e-05
2,270 When Can We Trust Progress Estimators for SQL Queries? 2005 SIGMOD 8.8310714e-05
2,404 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.6225576e-05
2,940 G-CARE: A Framework for Performance Benchmarking of Cardinality Estimation Techniques for Subgraph Matching 2020 SIGMOD 7.9381573e-05
3,351 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.4937347e-05
3,426 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB 7.4218997e-05
3,506 Identifying Robust Plans through Plan Diagram Reduction 2008 VLDB 7.3581509e-05
3,571 Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads 2017 VLDB 7.2991953e-05
3,605 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.2640711e-05
3,707 Query Suspend and Resume 2007 SIGMOD 7.1818056e-05
3,726 Parallelizing Query Optimization 2008 VLDB 7.1697834e-05
3,988 Adaptive Query Processing in the Looking Glass 2005 CIDR 6.9720123e-05
4,383 Content-Based Routing: Different Plans for Different Data 2005 VLDB 6.7329787e-05
4,444 Xplus: A SQL-Tuning-Aware Query Optimizer 2010 VLDB 6.6999439e-05
4,481 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.6754521e-05
4,742 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.5269203e-05
4,817 Efficiently Approximating Query Optimizer Plan Diagrams 2008 VLDB 6.4944225e-05
5,000 Permutable Compiled Queries: Dynamically Adapting Compiled Queries without Recompiling 2021 VLDB 6.4069917e-05
5,010 Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsoft SQL Server 2023 VLDB 6.4023732e-05
5,222 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.3103741e-05
5,365 A Pay-As-You-Go Framework for Query Execution Feedback 2008 VLDB 6.2462467e-05
5,514 StatAdvisor: Recommending Statistical Views 2009 VLDB 6.1901666e-05
5,529 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.18591e-05
5,537 Uncertainty Aware Query Execution Time Prediction 2014 VLDB 6.1820087e-05
5,552 Enabling Incremental Query Re-Optimization 2016 SIGMOD 6.1778488e-05
5,659 POP/FED: Progressive Query Optimization for Federated Queries in DB2 2006 VLDB 6.1311315e-05
5,829 Inspector Joins 2005 VLDB 6.073697e-05
5,898 On the Stability of Plan Costs and the Costs of Plan Stability 2010 VLDB 6.0471908e-05
5,983 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.0206841e-05
6,117 Proactive Re-optimization with Rio 2005 SIGMOD 5.9706217e-05
6,462 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 5.8717744e-05
6,543 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.8461929e-05
6,570 Impliance: A Next Generation Information Management Appliance 2007 CIDR 5.8374374e-05
6,663 Cheap Data Analytics using Cold Storage Devices 2016 VLDB 5.8091195e-05
6,688 ROX: Run-time Optimization of XQueries 2009 SIGMOD 5.8015211e-05
7,103 Efficient Adaptive Detection of Complex Event Patterns 2018 VLDB 5.7023779e-05
7,223 Dynamic Plan Generation for Parameterized Queries 2009 SIGMOD 5.6676987e-05
7,244 Stop-and-Restart Style Execution for Long Running Decision Support Queries 2007 VLDB 5.6638746e-05
7,366 Non-Invasive Progressive Optimization for In-Memory Databases 2016 VLDB 5.6322753e-05
7,495 On the Calculation of Optimality Ranges for Relational Query Execution Plans 2018 SIGMOD 5.6041473e-05
7,829 Robust Query Processing: Mission Possible 2020 VLDB 5.5360082e-05
7,856 AJoin: Ad-hoc Stream Joins at Scale 2020 VLDB 5.5306709e-05
7,891 Adaptive Optimizations of Recursive Queries in Teradata 2012 SIGMOD 5.5211516e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
35 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.00048481081
89 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.00035031529
100 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034385207
151 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00029161879
289 Optimization of Dynamic Query Evaluation Plans 1994 SIGMOD 0.00022278876
419 Cost-based Query Scrambling for Initial Delays 1998 SIGMOD 0.0001879684
474 Dynamic Query Evaluation Plans 1989 SIGMOD 0.00017894953
664 Exploiting Statistics on Query Expressions for Optimization 2002 SIGMOD 0.00015167825
1,321 Parametric Query Optimization for Linear and Piecewise Linear Cost Functions 2002 VLDB 0.00011162369
2,984 Multiple Join Size Estimation by Virtual Domains (extended abstract) 1993 PODS 7.8920597e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 3,426 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB
2 5,137 Exact Cardinality Query Optimization with Bounded Execution Cost 2019 SIGMOD
3 7,495 On the Calculation of Optimality Ranges for Relational Query Execution Plans 2018 SIGMOD
4 10,151 Coresets for Robust Query Optimization 2026 PODS
5 6,019 Robustness Metrics for Relational Query Execution Plans 2018 VLDB
6 1,256 Sampling-Based Query Re-Optimization 2016 SIGMOD
7 7,366 Non-Invasive Progressive Optimization for In-Memory Databases 2016 VLDB
8 566 Towards a Robust Query Optimizer: A Principled and Practical Approach 2005 SIGMOD
9 8,064 Progressive Optimization in a Shared-Nothing Parallel Database 2007 SIGMOD
10 13,902 Progressive Optimization in Action 2004 VLDB