DBScholar

Back to papers

PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees

Summary: PilotDB provides database-agnostic online AQP with a priori error guarantees using TAQA; BSAP enables fast block-level sampling. Prototype middleware on PostgreSQL, SQL Server, DuckDB; up to 126x speedups at 5% guaranteed error, with no DBMS changes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44103de119fe95c4
Venue
SIGMOD
Year
2025
Pagerank
5.4585522e-05
Overall Rank
7,749 | 47.92%
DOI
10.1145/3725335
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{zhu_sigmod25,
        title = {{PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees}},
        author = {Zhu, Yuxuan and Jin, Tengjun and Baziotis, Stefanos and Zhang, Chengsong and Mendis, Charith and Kang, Daniel},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725335},
        url = {https://dl.acm.org/doi/10.1145/3725335},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank Citing Paper Year Venue Pagerank
5,309 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1841176e-05
10,351 Evergreen: Efficient Claim Verification for Semantic Aggregates 2027 VLDB 4.9769913e-05
10,413 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 46 of 46 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
9 Online Aggregation 1997 SIGMOD 0.00076265429
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00047864281
37 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.0004772731
57 On Random Sampling over Joins 1999 SIGMOD 0.00040095727
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037724477
135 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00029858107
138 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00029618887
175 Simple Random Sampling from Relational Databases 1986 VLDB 0.00026776696
335 The Aqua Approximate Query Answering System 1999 SIGMOD 0.000206533
491 Error-Constrained COUNT Query Evaluation in Relational Databases 1991 SIGMOD 0.0001740646
564 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016297598
772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.0001409096
795 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013934719
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013543
930 Dynamic Sample Selection for Approximate Query Processing 2003 SIGMOD 0.00013009255
947 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00012920489
1,021 Online Aggregation for Large MapReduce Jobs 2011 VLDB 0.00012437619
1,061 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012208639
1,090 Scalable Approximate Query Processing With The DBO Engine 2007 SIGMOD 0.00012074369
1,182 ICICLES: Self-tuning Samples for Approximate Query Answering 2000 VLDB 0.00011615497
1,515 DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems 2021 VLDB 0.00010418766
1,828 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.547768e-05
1,869 G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data 2015 SIGMOD 9.4749419e-05
1,916 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 9.3822742e-05
2,073 A General-Purpose Counting Filter: Making Every Bit Count 2017 SIGMOD 9.0833741e-05
2,455 A Sampling Algebra for Aggregate Estimation 2013 VLDB 8.4377251e-05
2,476 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.407183e-05
2,618 The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database 2016 VLDB 8.2193318e-05
2,672 Relational Confidence Bounds Are Easy With The Bootstrap* 2005 SIGMOD 8.1456115e-05
3,213 Turbo-Charging Estimate Convergence in DBO 2009 VLDB 7.5304969e-05
3,417 Revisiting Reuse for Approximate Query Processing 2017 VLDB 7.3184905e-05
3,756 Accelerating Approximate Aggregation Queries with Expensive Predicates 2021 VLDB 7.0456217e-05
4,074 Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine 2024 SIGMOD 6.8175757e-05
4,463 DigitHist: a Histogram-Based Data Summary with Tight Error Bounds 2017 VLDB 6.5861255e-05
5,310 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.184026e-05
5,474 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.1159955e-05
5,573 Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020 SIGMOD 6.0774723e-05
5,829 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9764044e-05
6,002 Approximate Query Engines: Commercial Challenges and Research Opportunities 2017 SIGMOD 5.9149725e-05
7,398 Accelerating Aggregation Queries on Unstructured Streams of Data 2023 VLDB 5.5342864e-05
8,749 ProgressiveDB – Progressive Data Analytics as a Middleware 2019 VLDB 5.2865484e-05
8,822 Bias-Aware Sketches 2017 VLDB 5.2692495e-05
9,169 Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning 2023 SIGMOD 5.2139049e-05
10,316 DeepOLA: Online Aggregation for Deeply Nested Queries 2022 SIGMOD 5.0363234e-05
10,317 AB-tree: Index for Concurrent Random Sampling and Updates 2022 VLDB 5.0363234e-05
10,318 Distributed Wavelet Thresholding for Maximum Error Metrics 2016 SIGMOD 5.0363234e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,991 A Portable Middleware for Plan-Based Adaptive Query Processing 2026 VLDB
2 10,745 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB
3 10,413 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD
4 6,202 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD
5 772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD
6 1,916 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD
7 1,428 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD
8 11,800 Approximate Queries over Concurrent Updates 2023 VLDB
9 2,003 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD
10 11,088 Efficient Approximate Query Processing with Block Sampling 2025 CIDR