Expand your Training Limits! Generating Training Data for ML-based Data Management

Summary: DataFarm generates and labels large, heterogeneous query workloads for ML-driven data management. A data-driven whitebox learner uses small workloads and data to synthesize jobs, delivering up to 9x labeling gains (R^2) and 54x cost reductions vs prior work. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h61725a5ba4ac531d
Venue: SIGMOD
Year: 2021
Pagerank: 5.8708409e-05
Overall Rank: 6,141 | 58.73%
DOI: 10.1145/3448016.3457286

Incoming Non-self Citations Over Time

Authors

1. Francesco Ventura (Politecnico di Torino)
2. Zoi Kaoudi (German National Research Center for Information Technology; Technical University of Berlin)
3. Jorge-Arnulfo Quiané-Ruiz (German National Research Center for Information Technology; Technical University of Berlin)
4. Volker Markl (German National Research Center for Information Technology; Technical University of Berlin)

BibTeX Citation

@inproceedings{ventura_sigmod21,
        title = {{Expand your Training Limits! Generating Training Data for ML-based Data Management}},
        author = {Ventura, Francesco and Kaoudi, Zoi and Quiané-Ruiz, Jorge-Arnulfo and Markl, Volker},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457286},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457286},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,879	Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction	2022	VLDB	7.9126862e-05
7,021	Rethinking Learned Cost Models: Why Start from Scratch?	2023	SIGMOD	5.6168049e-05
7,464	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.5189616e-05
9,076	TensorSocket: Shared Data Loading for Deep Learning Training	2026	SIGMOD	5.2258409e-05
9,134	Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems	2024	VLDB	5.2223611e-05
9,541	Farm Your ML-based Query Optimizer's Food! - Human-Guided Training Data Generation -	2022	CIDR	5.1612414e-05
9,711	Database Gyms	2023	CIDR	5.1352441e-05
9,787	Optimizing Dataflow Systems for Scalable Interactive Visualization	2024	SIGMOD	5.1276108e-05
11,431	Learned Cost Models for Query Optimization: From Batch to Streaming Systems	2025	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
15	How Good Are Query Optimizers, Really?	2016	VLDB	0.00061067652
85	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00035876108
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034099838
144	Neo: A Learned Query Optimizer	2019	VLDB	0.00029090793
205	Snorkel: Rapid Training Data Creation with Weak Supervision	2018	VLDB	0.00025171314
318	DeepDB: Learn from Data, not from Queries!	2020	VLDB	0.00021166957
406	Deep Unsupervised Cardinality Estimation	2020	VLDB	0.00019050182
462	An End-to-End Learning-based Cost Estimator	2020	VLDB	0.00017836105
480	The Making of TPC-DS	2006	VLDB	0.00017615432
534	On Active Learning of Record Matching Packages	2010	SIGMOD	0.00016799
560	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.00016408613
1,280	AI Meets AI: Leveraging Query Executions to Improve Index Recommendations	2019	SIGMOD	0.00011224914
1,580	Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries	2020	SIGMOD	0.00010177136
2,278	Active Learning for ML Enhanced Database Systems	2020	SIGMOD	8.7057608e-05
2,837	Query Performance Prediction for Concurrent Queries using Graph Embedding	2020	VLDB	7.9495917e-05
3,272	Estimating Cardinalities with Deep Sketches	2019	SIGMOD	7.4711788e-05
3,402	RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! -	2018	VLDB	7.3269775e-05
5,392	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	6.1494698e-05
5,658	Uncertainty Aware Query Execution Time Prediction	2014	VLDB	6.0460211e-05
5,982	Active Learning of GAV Schema Mappings	2018	PODS	5.9250649e-05
8,294	Learning Table Access Cardinalities with LEO	2002	SIGMOD	5.3590057e-05
10,165	Rheem: Enabling Multi-Platform Task Execution	2016	SIGMOD	5.0664415e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,743	Machine Learning for Databases	2021	VLDB
2	1,223	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD
3	6,408	A Unified Transferable Model for ML-Enhanced DBMS	2022	CIDR
4	8,848	Machine Learning for Data Management: Problems and Solutions	2018	SIGMOD
5	4,059	Database-Agnostic Workload Management	2019	CIDR
6	10,158	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD
7	318	DeepDB: Learn from Data, not from Queries!	2020	VLDB
8	12,151	Query-Driven Learning for Next Generation Predictive Modeling & Analytics	2019	SIGMOD
9	9,082	Machine Learning for Graph Data Management and Query Processing	2025	VLDB
10	9,541	Farm Your ML-based Query Optimizer's Food! - Human-Guided Training Data Generation -	2022	CIDR