DBScholar

Back to papers

ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation

Summary: ShadowAQP allocates sample sizes per group-by/join attribute-value combinations and synthesizes table rows via a conditional VAE (with automatic encoding and model updates) to avoid costly raw sampling. With parallel multi-round aggregation, outlier-aware sampling and dimensionality reduction it yields up to 12.8x speedups and ~74% average error reduction versus SOTA. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
hf8c79ac12ff3b8e9
Venue
VLDB
Year
2023
Pagerank
5.2905894e-05
Overall Rank
8,667 | 41.75%
DOI
10.14778/3625054.3625059
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{gu_vldb23,
        title = {{ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation}},
        author = {Gu, Rong and Li, Han and Dai, Haipeng and Huang, Wenjie and Xue, Jie and Li, Meng and Zheng, Jiaqi and Cai, Haoran and Huang, Yihua and Chen, Guihai},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {13},
        pages = {4216--4229},
        doi = {10.14778/3625054.3625059},
        url = {https://doi.org/10.14778/3625054.3625059},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00047864281
57 On Random Sampling over Joins 1999 SIGMOD 0.00040095727
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
135 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00029858107
138 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00029618887
309 Approximate Query Processing Using Wavelets 2000 VLDB 0.00021376597
314 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.00021276452
318 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021166957
437 QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning 2019 VLDB 0.00018310278
462 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017836105
564 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016297598
596 Wander Join: Online Aggregation via Random Walks 2016 SIGMOD 0.00015782051
772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.0001409096
795 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013934719
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013543
947 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00012920489
1,065 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012202293
1,678 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 9.9056116e-05
1,797 IDEBench: A Benchmark for Interactive Data Exploration 2020 SIGMOD 9.6143465e-05
1,828 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.547768e-05
2,003 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD 9.2071735e-05
2,518 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3532841e-05
2,844 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9446987e-05
2,873 SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics 2017 CIDR 7.9190136e-05
3,053 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.7041081e-05
3,341 I've Seen "Enough": Incrementally Improving Visualizations to Support Rapid Decision Making 2017 VLDB 7.4028264e-05
3,424 AQP++: Connecting Approximate Query Processing With Aggregate Precomputation for Interactive Analytics 2018 SIGMOD 7.3084429e-05
4,690 Learned Cardinality Estimation for Similarity Queries 2021 SIGMOD 6.4667478e-05
4,779 Learned Approximate Query Processing: Make it Light, Accurate and Fast 2021 CIDR 6.416435e-05
5,474 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.1159955e-05
7,567 Selectivity Estimation on Streaming Spatio-Textual Data Using Local Correlations 2015 VLDB 5.4933119e-05
7,969 Efficient Approximate Algorithms for Empirical Entropy and Mutual Information 2021 SIGMOD 5.4135497e-05
8,282 Consistent and Flexible Selectivity Estimation for High-Dimensional Data 2021 SIGMOD 5.3616162e-05
8,851 Data Driven Approximation with Bounded Resources 2017 VLDB 5.2634608e-05
10,056 Efficient Insights Discovery through Conditional Generative Model based Query Approximation 2022 SIGMOD 5.0867413e-05
10,275 On Saving Outliers for Better Clustering over Noisy Data 2021 SIGMOD 5.0466043e-05
Previous Page 1 / 1 Next

Semantically Similar Papers