DBScholar

Back to papers

PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees

Summary: PilotDB provides database-agnostic online AQP with a priori error guarantees using TAQA; BSAP enables fast block-level sampling. Prototype middleware on PostgreSQL, SQL Server, DuckDB; up to 126x speedups at 5% guaranteed error, with no DBMS changes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
7316
Venue
SIGMOD
Year
2025
Pagerank
5.4667903e-05
Overall Rank
8,204 | 43.72%
DOI
10.1145/3725335

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{zhu_sigmod25,
        title = {{PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees}},
        author = {Zhu, Yuxuan and Jin, Tengjun and Baziotis, Stefanos and Zhang, Chengsong and Mendis, Charith and Kang, Daniel},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725335},
        url = {https://dl.acm.org/doi/10.1145/3725335},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
8,868 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 5.3546848e-05
10,185 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 46 of 46 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
9 Online Aggregation 1997 SIGMOD 0.00077458002
35 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.00048481081
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00048351457
54 On Random Sampling over Joins 1999 SIGMOD 0.00040810225
103 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00034161428
131 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00030424509
136 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00030123303
173 Simple Random Sampling from Relational Databases 1986 VLDB 0.00027273858
327 The Aqua Approximate Query Answering System 1999 SIGMOD 0.00021091539
484 Error-Constrained COUNT Query Evaluation in Relational Databases 1991 SIGMOD 0.00017746696
553 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016590619
772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00014147905
802 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013907725
819 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013815639
909 Dynamic Sample Selection for Approximate Query Processing 2003 SIGMOD 0.00013291205
931 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00013125812
1,009 Online Aggregation for Large MapReduce Jobs 2011 VLDB 0.00012684342
1,064 Scalable Approximate Query Processing With The DBO Engine 2007 SIGMOD 0.00012336248
1,108 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012145154
1,166 ICICLES: Self-tuning Samples for Approximate Query Answering 2000 VLDB 0.00011850439
1,799 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.7326398e-05
1,827 G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data 2015 SIGMOD 9.6690206e-05
1,832 DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems 2021 VLDB 9.6607418e-05
1,872 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 9.5759874e-05
2,043 A General-Purpose Counting Filter: Making Every Bit Count 2017 SIGMOD 9.2674387e-05
2,413 A Sampling Algebra for Aggregate Estimation 2013 VLDB 8.6116764e-05
2,499 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.4993549e-05
2,597 The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database 2016 VLDB 8.3604418e-05
2,633 Relational Confidence Bounds Are Easy With The Bootstrap* 2005 SIGMOD 8.3224527e-05
3,157 Turbo-Charging Estimate Convergence in DBO 2009 VLDB 7.6911286e-05
3,370 Revisiting Reuse for Approximate Query Processing 2017 VLDB 7.4700891e-05
3,907 Accelerating Approximate Aggregation Queries with Expensive Predicates 2021 VLDB 7.0278233e-05
4,405 DigitHist: a Histogram-Based Data Summary with Tight Error Bounds 2017 VLDB 6.7218674e-05
5,222 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.3103741e-05
5,358 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.2492955e-05
5,469 Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine 2024 SIGMOD 6.2073056e-05
5,524 Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020 SIGMOD 6.1868208e-05
5,743 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 6.1025457e-05
5,906 Approximate Query Engines: Commercial Challenges and Research Opportunities 2017 SIGMOD 6.0457047e-05
7,648 Accelerating Aggregation Queries on Unstructured Streams of Data 2023 VLDB 5.575838e-05
8,578 ProgressiveDB – Progressive Data Analytics as a Middleware 2019 VLDB 5.4091471e-05
8,653 Bias-Aware Sketches 2017 VLDB 5.3914428e-05
9,008 Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning 2023 SIGMOD 5.3335632e-05
10,092 DeepOLA: Online Aggregation for Deeply Nested Queries 2022 SIGMOD 5.1530576e-05
10,093 AB-tree: Index for Concurrent Random Sampling and Updates 2022 VLDB 5.1530576e-05
10,094 Distributed Wavelet Thresholding for Maximum Error Metrics 2016 SIGMOD 5.1530576e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 2,206 DAQ: A New Paradigm for Approximate Query Processing 2015 VLDB
2 10,185 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD
3 10,553 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB
4 6,206 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD
5 772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD
6 1,872 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD
7 1,401 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD
8 11,484 Approximate Queries over Concurrent Updates 2023 VLDB
9 1,962 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD
10 10,634 Efficient Approximate Query Processing with Block Sampling 2025 CIDR