DBScholar

Back to papers

ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation

Summary: ShadowAQP allocates sample sizes per group-by/join attribute-value combinations and synthesizes table rows via a conditional VAE (with automatic encoding and model updates) to avoid costly raw sampling. With parallel multi-round aggregation, outlier-aware sampling and dimensionality reduction it yields up to 12.8x speedups and ~74% average error reduction versus SOTA. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
hf8c79ac12ff3b8e9
Venue
VLDB
Year
2023
Pagerank
5.2730954e-05
Overall Rank
8,685 | 41.79%
DOI
10.14778/3625054.3625059
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{gu_vldb23,
        title = {{ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation}},
        author = {Gu, Rong and Li, Han and Dai, Haipeng and Huang, Wenjie and Xue, Jie and Li, Meng and Zheng, Jiaqi and Cai, Haoran and Huang, Yihua and Chen, Guihai},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {13},
        pages = {4216--4229},
        doi = {10.14778/3625054.3625059},
        url = {https://doi.org/10.14778/3625054.3625059},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
36 Accurate Estimation Of The Number Of Tuples Satisfying A Condition 1984 SIGMOD 0.00047770864
57 On Random Sampling over Joins 1999 SIGMOD 0.0003999751
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035920657
135 Ripple Joins for Online Aggregation 1999 SIGMOD 0.00029805026
138 Join Synopses for Approximate Query Answering 1999 SIGMOD 0.00029532435
309 An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning 2019 SIGMOD 0.0002143249
311 Approximate Query Processing Using Wavelets 2000 VLDB 0.00021315058
320 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021128745
411 QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning 2019 VLDB 0.0001874043
453 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.0001801482
564 Congressional Samples for Approximate Answering of Group-By Queries 2000 SIGMOD 0.00016251304
594 Wander Join: Online Aggregation via Random Walks 2016 SIGMOD 0.00015814493
770 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00014086699
793 Random Sampling over Joins Revisited 2018 SIGMOD 0.00013903938
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013503124
951 Aqua: A Fast Decision Support System Using Approximate Query Answers 1999 VLDB 0.00012886042
1,064 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012181459
1,681 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 9.8821344e-05
1,804 IDEBench: A Benchmark for Interactive Data Exploration 2020 SIGMOD 9.5971444e-05
1,839 DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models 2019 SIGMOD 9.5187688e-05
2,014 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD 9.1775869e-05
2,523 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3316032e-05
2,852 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9201312e-05
2,871 SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics 2017 CIDR 7.9024682e-05
3,060 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.6828463e-05
3,348 I've Seen "Enough": Incrementally Improving Visualizations to Support Rapid Decision Making 2017 VLDB 7.3783668e-05
3,435 AQP++: Connecting Approximate Query Processing With Aggregate Precomputation for Interactive Analytics 2018 SIGMOD 7.2845431e-05
4,703 Learned Cardinality Estimation for Similarity Queries 2021 SIGMOD 6.4458272e-05
4,792 Learned Approximate Query Processing: Make it Light, Accurate and Fast 2021 CIDR 6.4010108e-05
5,487 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 6.0974772e-05
7,581 Selectivity Estimation on Streaming Spatio-Textual Data Using Local Correlations 2015 VLDB 5.4753678e-05
7,970 Efficient Approximate Algorithms for Empirical Entropy and Mutual Information 2021 SIGMOD 5.3997018e-05
8,297 Consistent and Flexible Selectivity Estimation for High-Dimensional Data 2021 SIGMOD 5.3438874e-05
8,870 Data Driven Approximation with Bounded Resources 2017 VLDB 5.246202e-05
10,087 Efficient Insights Discovery through Conditional Generative Model based Query Approximation 2022 SIGMOD 5.0699214e-05
10,302 On Saving Outliers for Better Clustering over Noisy Data 2021 SIGMOD 5.0299171e-05
Previous Page 1 / 1 Next

Semantically Similar Papers