DBScholar

Back to papers

PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees

Summary: PilotDB provides database-agnostic online AQP with a priori error guarantees using TAQA; BSAP enables fast block-level sampling. Prototype middleware on PostgreSQL, SQL Server, DuckDB; up to 126x speedups at 5% guaranteed error, with no DBMS changes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44103de119fe95c4
Venue
SIGMOD
Year
2025
Pagerank
5.3751366e-05
Overall Rank
8,223 | 44.72%
DOI
10.1145/3725335

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{zhu_sigmod25,
        title = {{PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees}},
        author = {Zhu, Yuxuan and Jin, Tengjun and Baziotis, Stefanos and Zhang, Chengsong and Mendis, Charith and Kang, Daniel},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725335},
        url = {https://dl.acm.org/doi/10.1145/3725335},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
5,501 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1027188e-05
10,401 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 46 of 46 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
9 Online Aggregation 1997 SIGMOD 0.00076195956
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00047863192
37 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.00047731453
57 On Random Sampling over Joins 1999 SIGMOD 0.00040108301
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037720227
135 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00029866033
138 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00029627449
175 Simple Random Sampling from Relational Databases 1986 VLDB 0.00026784195
336 The Aqua Approximate Query Answering System 1999 SIGMOD 0.00020657819
492 Error-Constrained COUNT Query Evaluation in Relational Databases 1991 SIGMOD 0.00017408001
564 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016296665
784 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00014012614
795 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013938779
840 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.0001354605
931 Dynamic Sample Selection for Approximate Query Processing 2003 SIGMOD 0.00013011667
948 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00012914559
1,022 Online Aggregation for Large MapReduce Jobs 2011 VLDB 0.00012438826
1,082 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012122749
1,090 Scalable Approximate Query Processing With The DBO Engine 2007 SIGMOD 0.00012077577
1,183 ICICLES: Self-tuning Samples for Approximate Query Answering 2000 VLDB 0.00011616705
1,515 DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems 2021 VLDB 0.00010417728
1,829 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.5510333e-05
1,868 G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data 2015 SIGMOD 9.4754064e-05
1,916 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 9.3837729e-05
2,071 A General-Purpose Counting Filter: Making Every Bit Count 2017 SIGMOD 9.0866982e-05
2,456 A Sampling Algebra for Aggregate Estimation 2013 VLDB 8.4377192e-05
2,478 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.4079121e-05
2,618 The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database 2016 VLDB 8.2217101e-05
2,677 Relational Confidence Bounds Are Easy With The Bootstrap* 2005 SIGMOD 8.1461074e-05
3,213 Turbo-Charging Estimate Convergence in DBO 2009 VLDB 7.5328015e-05
3,419 Revisiting Reuse for Approximate Query Processing 2017 VLDB 7.3190065e-05
3,874 Accelerating Approximate Aggregation Queries with Expensive Predicates 2021 VLDB 6.953738e-05
4,074 Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine 2024 SIGMOD 6.8198673e-05
4,462 DigitHist: a Histogram-Based Data Summary with Tight Error Bounds 2017 VLDB 6.5880099e-05
5,316 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.1836681e-05
5,473 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.1178467e-05
5,573 Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020 SIGMOD 6.0794156e-05
5,831 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9782109e-05
6,004 Approximate Query Engines: Commercial Challenges and Research Opportunities 2017 SIGMOD 5.9166815e-05
7,801 Accelerating Aggregation Queries on Unstructured Streams of Data 2023 VLDB 5.4507311e-05
8,744 ProgressiveDB – Progressive Data Analytics as a Middleware 2019 VLDB 5.2881174e-05
8,815 Bias-Aware Sketches 2017 VLDB 5.2708103e-05
9,161 Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning 2023 SIGMOD 5.2154395e-05
10,314 DeepOLA: Online Aggregation for Deeply Nested Queries 2022 SIGMOD 5.0377739e-05
10,315 AB-tree: Index for Concurrent Random Sampling and Updates 2022 VLDB 5.0377739e-05
10,316 Distributed Wavelet Thresholding for Maximum Error Metrics 2016 SIGMOD 5.0377739e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,982 A Portable Middleware for Plan-Based Adaptive Query Processing 2026 VLDB
2 10,735 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB
3 10,401 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD
4 6,221 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD
5 784 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD
6 1,916 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD
7 1,428 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD
8 11,794 Approximate Queries over Concurrent Updates 2023 VLDB
9 2,000 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD
10 11,079 Efficient Approximate Query Processing with Block Sampling 2025 CIDR