Expand your Training Limits! Generating Training Data for ML-based Data Management

Summary: DataFarm generates and labels large, heterogeneous query workloads for ML-driven data management. A data-driven whitebox learner uses small workloads and data to synthesize jobs, delivering up to 9x labeling gains (R^2) and 54x cost reductions vs prior work. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6178
Venue: SIGMOD
Year: 2021
Pagerank: 5.0273414e-05
Overall Rank: 6,507 | 54.78%
DOI: 10.1145/3448016.3457286

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,819	Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction	2022	VLDB	6.7267885e-05
7,742	Rethinking Learned Cost Models: Why Start from Scratch?	2023	SIGMOD	4.6585812e-05
8,731	TensorSocket: Shared Data Loading for Deep Learning Training	2026	SIGMOD	4.4520434e-05
8,961	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	4.4171776e-05
9,012	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	4.4059413e-05
9,297	Farm Your ML-based Query Optimizer's Food! - Human-Guided Training Data Generation -	2022	CIDR	4.357774e-05
9,469	Database Gyms	2023	CIDR	4.3304872e-05
9,600	Optimizing Dataflow Systems for Scalable Interactive Visualization	2024	SIGMOD	4.3136057e-05
10,844	Learned Cost Models for Query Optimization: From Batch to Streaming Systems	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
71	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059446482
181	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00036970794
203	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034868567
252	Snorkel: Rapid Training Data Creation with Weak Supervision	2018	VLDB	0.00030532082
329	Neo: A Learned Query Optimizer	2019	VLDB	0.00027301488
507	On Active Learning of Record Matching Packages	2010	SIGMOD	0.00021474096
606	DeepDB: Learn from Data, not from Queries!	2020	VLDB	0.00019251186
659	The Making of TPC-DS	2006	VLDB	0.00018514913
752	Deep Unsupervised Cardinality Estimation	2020	VLDB	0.00017138049
804	An End-to-End Learning-based Cost Estimator	2020	VLDB	0.0001643674
876	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.00015660534
1,856	AI Meets AI: Leveraging Query Executions to Improve Index Recommendations	2019	SIGMOD	0.00010319105
2,364	Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries	2020	SIGMOD	8.955077e-05
3,144	Active Learning for ML Enhanced Database Systems	2020	SIGMOD	7.4844943e-05
3,270	RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! -	2018	VLDB	7.3013196e-05
3,580	Query Performance Prediction for Concurrent Queries using Graph Embedding	2020	VLDB	6.9460425e-05
3,725	Estimating Cardinalities with Deep Sketches	2019	SIGMOD	6.8117015e-05
5,699	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	5.3655096e-05
6,277	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	5.1260947e-05
8,118	Learning Table Access Cardinalities with LEO	2002	SIGMOD	4.5783775e-05
9,809	Rheem: Enabling Multi-Platform Task Execution	2016	SIGMOD	4.2744056e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,787	Machine Learning for Databases	2021	VLDB	5.3256401e-05
1,534	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011462072
6,774	A Unified Transferable Model for ML-Enhanced DBMS	2022	CIDR	4.9253635e-05
8,637	Machine Learning for Data Management: Problems and Solutions	2018	SIGMOD	4.4755972e-05
4,547	Database-Agnostic Workload Management	2019	CIDR	6.0904384e-05
9,775	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD	4.2815042e-05
606	DeepDB: Learn from Data, not from Queries!	2020	VLDB	0.00019251186
11,655	Query-Driven Learning for Next Generation Predictive Modeling & Analytics	2019	SIGMOD	4.1905499e-05
10,847	Machine Learning for Graph Data Management and Query Processing	2025	VLDB	4.1905499e-05
9,297	Farm Your ML-based Query Optimizer's Food! - Human-Guided Training Data Generation -	2022	CIDR	4.357774e-05