DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models

Summary: DBEst revisits AQP with ML regression models and density estimators to deliver fast, accurate analytical approximations. It targets low memory, broad aggregate support, and integration with existing systems; TPC-DS and real data show gains over state-of-the-art AQP engines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5829
Venue: SIGMOD
Year: 2019
Pagerank: 9.7326398e-05
Overall Rank: 1,799 | 87.66%
DOI: 10.1145/3299869.3324958

Incoming Non-self Citations Over Time

Authors

1. Qingzhi Ma (University of Warwick)
2. Peter Triantafillou (University of Warwick)

BibTeX Citation

@inproceedings{ma_sigmod19,
        title = {{DBEst: Revisiting Approximate Query Processing Engines with Machine Learning Models}},
        author = {Ma, Qingzhi and Triantafillou, Peter},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3324958},
        url = {https://dl.acm.org/doi/10.1145/3299869.3324958},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
323	DeepDB: Learn from Data, not from Queries!	2020	VLDB	0.00021264788
1,061	Are We Ready For Learned Cardinality Estimation?	2021	VLDB	0.00012369764
3,283	A Learned Sketch for Subgraph Counting	2021	SIGMOD	7.56675e-05
4,368	Lightweight and Accurate Cardinality Estimation by Neural Network Gaussian Process	2022	SIGMOD	6.7393882e-05
4,789	Learned Approximate Query Processing: Make it Light, Accurate and Fast	2021	CIDR	6.5072039e-05
5,551	PGMJoins: Random Join Sampling with Graphical Models	2021	SIGMOD	6.1782856e-05
5,789	Seiden: Revisiting Query Processing in Video Database Systems	2023	VLDB	6.0874367e-05
6,132	Detect, Distill and Update: Learned DB Systems Facing Out of Distribution Data	2023	SIGMOD	5.9660278e-05
6,262	Mosaic: A Sample-Based Database System for Open World Query Processing	2020	CIDR	5.9361728e-05
6,804	A Neural Database for Differentially Private Spatial Range Queries	2022	VLDB	5.768025e-05
7,351	PairwiseHist: Fast, Accurate and Space-Efficient Approximate Query Processing with Data Compression	2024	VLDB	5.6354898e-05
7,551	Enabling Efficient and General Subpopulation Analytics in Multidimensional Data Streams	2022	VLDB	5.6006414e-05
7,847	Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines	2024	VLDB	5.5330423e-05
8,161	LAQy: Efficient and Reusable Query Approximations via Lazy Sampling	2023	SIGMOD	5.4752972e-05
8,204	PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees	2025	SIGMOD	5.4667903e-05
8,492	ShadowAQP: Efficient Approximate Group-by and Join Query via Attribute-oriented Sample Size Allocation and Data Generation	2023	VLDB	5.4145838e-05
9,101	NeuroSketch: Fast and Approximate Evaluation of Range Aggregate Queries with Neural Networks	2023	SIGMOD	5.324758e-05
9,392	A Step Toward Deep Online Aggregation	2023	SIGMOD	5.2755515e-05
9,587	Machine Unlearning in Learned Databases: An Experimental Analysis	2024	SIGMOD	5.2525104e-05
9,860	Efficient Insights Discovery through Conditional Generative Model based Query Approximation	2022	SIGMOD	5.2059582e-05
10,041	DBMS Fitting: Why should we learn what we already know?	2020	CIDR	5.1709251e-05
10,185	A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra	2026	SIGMOD	5.093636e-05
10,196	Are Learned DBMS Components Robust to Workload Drift?: [Experiments & Analysis]	2026	SIGMOD	5.093636e-05
10,760	FAAQP: Fast and Accurate Approximate Query Processing based on Bitmap-augmented Sum-Product Network	2025	SIGMOD	5.093636e-05
10,831	Holistic query Approximation via RL Modeling	2025	VLDB	5.093636e-05
10,891	Cardinality Estimation for Having-Clauses	2025	VLDB	5.093636e-05
11,104	Datamap-Driven Tabular Coreset Selection for Classifier Training	2025	VLDB	5.093636e-05
11,159	PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation	2024	SIGMOD	5.093636e-05
11,484	Approximate Queries over Concurrent Updates	2023	VLDB	5.093636e-05
11,625	Accelerating Complex Analytics using Speculation	2021	CIDR	5.093636e-05
11,651	XLJoins	2021	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00077458002
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
32	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00050111008
54	On Random Sampling over Joins	1999	SIGMOD	0.00040810225
136	Join Synopses for Approximate Query Answering	1999	SIGMOD	0.00030123303
237	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.0002369895
327	The Aqua Approximate Query Answering System	1999	SIGMOD	0.00021091539
330	Impala: A Modern, Open-Source SQL Engine for Hadoop	2015	CIDR	0.0002104801
461	Query-based Workload Forecasting for Self-Driving Database Management Systems	2018	SIGMOD	0.00018068441
476	The Making of TPC-DS	2006	VLDB	0.00017860667
536	Learning Linear Regression Models over Factorized Joins	2016	SIGMOD	0.0001693369
710	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014715033
772	VerdictDB: Universalizing Approximate Query Processing	2018	SIGMOD	0.00014147905
802	Random Sampling over Joins Revisited	2018	SIGMOD	0.00013907725
819	Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters	2016	SIGMOD	0.00013815639
1,009	Online Aggregation for Large MapReduce Jobs	2011	VLDB	0.00012684342
1,108	Approximate Query Processing: No Silver Bullet	2017	SIGMOD	0.00012145154
1,198	Overview of Data Exploration Techniques	2015	SIGMOD	0.00011706307
1,437	Querying Continuous Functions in a Database System	2008	SIGMOD	0.00010790718
1,995	Database Learning: Toward a Database that Becomes Smarter Every Time	2017	SIGMOD	9.3403665e-05
2,206	DAQ: A New Paradigm for Approximate Query Processing	2015	VLDB	8.957715e-05
2,207	Shark: Fast Data Analysis Using Coarse-grained Distributed Memory	2012	SIGMOD	8.9565862e-05
3,042	Continuous Sampling for Online Aggregation Over Multiple Queries	2010	SIGMOD	7.8231049e-05
3,144	Interactive Data Exploration Using Semantic Windows	2014	SIGMOD	7.7134729e-05
3,885	Apache Tez: A Unifying Framework for Modeling and Building Data Processing Applications	2015	SIGMOD	7.0475239e-05
3,930	Data Canopy: Accelerating Exploratory Statistical Analysis	2017	SIGMOD	7.0102082e-05
5,225	Approximate Lifted Inference with Probabilistic Databases	2015	VLDB	6.310093e-05
5,820	A Database System with Amnesia	2017	CIDR	6.0761631e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,358	ABS: a System for Scalable Approximate Queries with Accuracy Guarantees	2014	SIGMOD
2	10,185	A Backend-Agnostic Compiler for Approximate Query Processing with Probabilistic Tensor Algebra	2026	SIGMOD
3	7,193	dbET: Execution Time Distribution-based Plan Selection	2023	SIGMOD
4	6,543	Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation	2023	SIGMOD
5	9,215	Deep Query Optimization	2019	SIGMOD
6	10,881	Robust Plan Evaluation based on Approximate Probabilistic Machine Learning	2025	VLDB
7	1,064	Scalable Approximate Query Processing With The DBO Engine	2007	SIGMOD
8	9,353	On Efficient Approximate Queries over Machine Learning Models	2023	VLDB
9	11,845	Query-Driven Learning for Next Generation Predictive Modeling & Analytics	2019	SIGMOD
10	4,789	Learned Approximate Query Processing: Make it Light, Accurate and Fast	2021	CIDR