DBScholar

Back to papers

PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees

Summary: PilotDB provides database-agnostic online AQP with a priori error guarantees using TAQA; BSAP enables fast block-level sampling. Prototype middleware on PostgreSQL, SQL Server, DuckDB; up to 126x speedups at 5% guaranteed error, with no DBMS changes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h44103de119fe95c4
Venue
SIGMOD
Year
2025
Pagerank
5.4457135e-05
Overall Rank
7,745 | 48.09%
DOI
10.1145/3725335
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{zhu_sigmod25,
        title = {{PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees}},
        author = {Zhu, Yuxuan and Jin, Tengjun and Baziotis, Stefanos and Zhang, Chengsong and Mendis, Charith and Kang, Daniel},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725335},
        url = {https://dl.acm.org/doi/10.1145/3725335},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank Citing Paper Year Venue Pagerank
4,996 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.3095672e-05
10,418 Evergreen: Efficient Claim Verification for Semantic Aggregates 2027 VLDB 4.9605343e-05
10,479 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 46 of 46 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
9 Online Aggregation 1997 SIGMOD 0.00076079812
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00047770864
37 Improved Histograms for Selectivity Estimation of Range Predicates 1996 SIGMOD 0.00047654188
57 On Random Sampling over Joins 1999 SIGMOD 0.0003999751
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037688945
135 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00029805026
138 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00029532435
175 Simple Random Sampling from Relational Databases 1986 VLDB 0.00026701703
337 The Aqua Approximate Query Answering System 1999 SIGMOD 0.00020593498
492 Error-Constrained COUNT Query Evaluation in Relational Databases 1991 SIGMOD 0.00017359343
564 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016251304
770 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00014086699
793 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013903938
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013503124
935 Dynamic Sample Selection for Approximate Query Processing 2003 SIGMOD 0.00012968914
951 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00012886042
1,022 Online Aggregation for Large MapReduce Jobs 2011 VLDB 0.00012400958
1,065 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012181098
1,095 Scalable Approximate Query Processing With The DBO Engine 2007 SIGMOD 0.00012036913
1,186 ICICLES: Self-tuning Samples for Approximate Query Answering 2000 VLDB 0.00011581468
1,513 DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems 2021 VLDB 0.00010394557
1,839 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.5187688e-05
1,874 G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data 2015 SIGMOD 9.4470874e-05
1,924 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 9.3535088e-05
2,081 A General-Purpose Counting Filter: Making Every Bit Count 2017 SIGMOD 9.0581443e-05
2,461 A Sampling Algebra for Aggregate Estimation 2013 VLDB 8.4123214e-05
2,481 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD 8.3862675e-05
2,622 The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database 2016 VLDB 8.1976067e-05
2,682 Relational Confidence Bounds Are Easy With The Bootstrap* 2005 SIGMOD 8.1203255e-05
3,220 Turbo-Charging Estimate Convergence in DBO 2009 VLDB 7.5077984e-05
3,428 Revisiting Reuse for Approximate Query Processing 2017 VLDB 7.2957009e-05
3,747 Accelerating Approximate Aggregation Queries with Expensive Predicates 2021 VLDB 7.0351475e-05
4,095 Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine 2024 SIGMOD 6.7952274e-05
4,480 DigitHist: a Histogram-Based Data Summary with Tight Error Bounds 2017 VLDB 6.566036e-05
5,324 CliffGuard: A Principled Framework for Finding Robust Database Designs 2015 SIGMOD 6.1645235e-05
5,487 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.0974772e-05
5,546 Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020 SIGMOD 6.071729e-05
5,841 Joins on Samples: A Theoretical Guide for Practitioners 2020 VLDB 5.9569427e-05
6,014 Approximate Query Engines: Commercial Challenges and Research Opportunities 2017 SIGMOD 5.8956963e-05
7,416 Accelerating Aggregation Queries on Unstructured Streams of Data 2023 VLDB 5.5159866e-05
8,769 ProgressiveDB – Progressive Data Analytics as a Middleware 2019 VLDB 5.2691244e-05
8,839 Bias-Aware Sketches 2017 VLDB 5.2518828e-05
9,182 Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning 2023 SIGMOD 5.1985233e-05
10,344 DeepOLA: Online Aggregation for Deeply Nested Queries 2022 SIGMOD 5.0197268e-05
10,345 AB-tree: Index for Concurrent Random Sampling and Updates 2022 VLDB 5.0197268e-05
10,346 Distributed Wavelet Thresholding for Maximum Error Metrics 2016 SIGMOD 5.0197268e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,052 A Portable Middleware for Plan-Based Adaptive Query Processing 2026 VLDB
2 10,806 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB
3 10,479 A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra 2026 SIGMOD
4 6,198 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD
5 770 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD
6 1,924 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD
7 1,435 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD
8 11,844 Approximate Queries over Concurrent Updates 2023 VLDB
9 2,014 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD
10 11,149 Efficient Approximate Query Processing with Block Sampling 2025 CIDR