DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models

Summary: DBEst revisits AQP with ML regression models and density estimators to deliver fast, accurate analytical approximations. It targets low memory, broad aggregate support, and integration with existing systems; TPC-DS and real data show gains over state-of-the-art AQP engines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h694ccd533ed12028
Venue: SIGMOD
Year: 2019
Pagerank: 9.547768e-05
Overall Rank: 1,828 | 87.72%
DOI: 10.1145/3299869.3324958

Incoming Non-self Citations Over Time

Authors

1. Qingzhi Ma (University of Warwick)
2. Peter Triantafillou (University of Warwick)

BibTeX Citation

@inproceedings{ma_sigmod19,
        title = {{DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models}},
        author = {Ma, Qingzhi and Triantafillou, Peter},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3324958},
        url = {https://dl.acm.org/doi/10.1145/3299869.3324958},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
318	DeepDB: Learn from Data, not from Queries!	2020	VLDB	0.00021166957
1,065	Are We Ready For Learned Cardinality Estimation?	2021	VLDB	0.00012202293
3,161	A Learned Sketch for Subgraph Counting	2021	SIGMOD	7.5771609e-05
4,459	Lightweight and Accurate Cardinality Estimation by Neural Network Gaussian Process	2022	SIGMOD	6.5883555e-05
4,779	Learned Approximate Query Processing: Make it Light, Accurate and Fast	2021	CIDR	6.416435e-05
5,214	Seiden: Revisiting Query Processing in Video Database Systems	2023	VLDB	6.2224191e-05
5,657	PGMJoins: Random Join Sampling with Graphical Models	2021	SIGMOD	6.0461e-05
5,715	Detect, Distill and Update: Learned DB Systems Facing Out of Distribution Data	2023	SIGMOD	6.0178585e-05
5,790	A Neural Database for Differentially Private Spatial Range Queries	2022	VLDB	5.9914362e-05
6,285	Mosaic: A Sample-Based Database System for Open World Query Processing	2020	CIDR	5.8209714e-05
7,363	PairwiseHist: Fast, Accurate and Space-Efficient Approximate Query Processing with Data Compression	2024	VLDB	5.5404386e-05
7,707	Enabling Efficient and General Subpopulation Analytics in Multidimensional Data Streams	2022	VLDB	5.4723863e-05
7,749	PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees	2025	SIGMOD	5.4585522e-05
7,983	Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines	2024	VLDB	5.4111208e-05
8,336	LAQy: Efficient and Reusable Query Approximations via Lazy Sampling	2023	SIGMOD	5.3508072e-05
8,667	ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation	2023	VLDB	5.2905894e-05
8,952	Machine Unlearning in Learned Databases: An Experimental Analysis	2024	SIGMOD	5.2517414e-05
9,219	NeuroSketch: Fast and Approximate Evaluation of Range Aggregate Queries with Neural Networks	2023	SIGMOD	5.2037933e-05
9,583	A Step Toward Deep Online Aggregation	2023	SIGMOD	5.154741e-05
10,056	Efficient Insights Discovery through Conditional Generative Model based Query Approximation	2022	SIGMOD	5.0867413e-05
10,223	DBMS Fitting: Why should we learn what we already know?	2020	CIDR	5.0558336e-05
10,413	A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra	2026	SIGMOD	4.9769913e-05
10,424	Are Learned DBMS Components Robust to Workload Drift?: [Experiments & Analysis]	2026	SIGMOD	4.9769913e-05
11,193	FAAQP: Fast and Accurate Approximate Query Processing based on Bitmap-augmented Sum-Product Network	2025	SIGMOD	4.9769913e-05
11,247	Holistic query Approximation via RL Modeling	2025	VLDB	4.9769913e-05
11,298	Cardinality Estimation for Having-Clauses	2025	VLDB	4.9769913e-05
11,460	Datamap-Driven Tabular Coreset Selection for Classifier Training	2025	VLDB	4.9769913e-05
11,512	PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation	2024	SIGMOD	4.9769913e-05
11,800	Approximate Queries over Concurrent Updates	2023	VLDB	4.9769913e-05
11,938	Accelerating Complex Analytics using Speculation	2021	CIDR	4.9769913e-05
11,964	XLJoins	2021	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076265429
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055384955
31	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00049821554
57	On Random Sampling over Joins	1999	SIGMOD	0.00040095727
138	Join Synopses for Approximate Query Answering	1999	SIGMOD	0.00029618887
233	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023774958
327	Impala: A Modern, Open-Source SQL Engine for Hadoop	2015	CIDR	0.00020942751
335	The Aqua Approximate Query Answering System	1999	SIGMOD	0.000206533
461	Query-based Workload Forecasting for Self-Driving Database Management Systems	2018	SIGMOD	0.00017841988
480	The Making of TPC-DS	2006	VLDB	0.00017615432
521	Learning Linear Regression Models over Factorized Joins	2016	SIGMOD	0.00016923519
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014778299
772	VerdictDB: Universalizing Approximate Query Processing	2018	SIGMOD	0.0001409096
795	Random Sampling over Joins Revisited	2018	SIGMOD	0.00013934719
841	Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters	2016	SIGMOD	0.00013543
1,021	Online Aggregation for Large MapReduce Jobs	2011	VLDB	0.00012437619
1,061	Approximate Query Processing: No Silver Bullet	2017	SIGMOD	0.00012208639
1,216	Overview of Data Exploration Techniques	2015	SIGMOD	0.00011487268
1,457	Querying Continuous Functions in a Database System	2008	SIGMOD	0.00010585094
2,028	Database Learning: Toward a Database that Becomes Smarter Every Time	2017	SIGMOD	9.1584244e-05
2,219	DAQ: A New Paradigm for Approximate Query Processing	2015	VLDB	8.8127129e-05
2,233	Shark: Fast Data Analysis Using Coarse-grained Distributed Memory	2012	SIGMOD	8.7921042e-05
3,085	Continuous Sampling for Online Aggregation Over Multiple Queries	2010	SIGMOD	7.6607519e-05
3,203	Interactive Data Exploration Using Semantic Windows	2014	SIGMOD	7.5392994e-05
3,891	Apache Tez: A Unifying Framework for Modeling and Building Data Processing Applications	2015	SIGMOD	6.9400948e-05
3,985	Data Canopy: Accelerating Exploratory Statistical Analysis	2017	SIGMOD	6.8708857e-05
5,342	Approximate Lifted Inference with Probabilistic Databases	2015	VLDB	6.171876e-05
5,927	A Database System with Amnesia	2017	CIDR	5.9413918e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,474	ABS: a System for Scalable Approximate Queries with Accuracy Guarantees	2014	SIGMOD
2	10,413	A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra	2026	SIGMOD
3	6,796	dbET: Execution Time Distribution-based Plan Selection	2023	SIGMOD
4	6,664	Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation	2023	SIGMOD
5	9,342	Deep Query Optimization	2019	SIGMOD
6	11,291	Robust Plan Evaluation based on Approximate Probabilistic Machine Learning	2025	VLDB
7	1,090	Scalable Approximate Query Processing With The DBO Engine	2007	SIGMOD
8	5,905	On Efficient Approximate Queries over Machine Learning Models	2023	VLDB
9	12,151	Query-Driven Learning for Next Generation Predictive Modeling & Analytics	2019	SIGMOD
10	4,779	Learned Approximate Query Processing: Make it Light, Accurate and Fast	2021	CIDR