DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data

Summary: DiffPrep introduces differentiable bi-level search for preprocessing pipelines, enabling optimization in a continuous space. Continuous relaxation enables descent to find pipelines with a single training, yielding up to 6.6pp gains on 15/18 datasets. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6686
Venue: SIGMOD
Year: 2023
Pagerank: 5.5087325e-05
Overall Rank: 5,429 | 62.24%
DOI: 10.1145/3589328

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,743	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.456315e-05
10,316	LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning	2026	VLDB	4.1945683e-05
10,758	Stress-Testing ML Pipelines with Adversarial Data Corruption	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
791	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00016629664
921	Democratizing Data Science through Interactive Curation of ML Pipelines	2019	SIGMOD	0.00015337438
1,612	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011142794
1,627	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011086905
1,914	Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks	2020	SIGMOD	0.00010109102
2,302	Nearest Neighbor Classifiers over Incomplete Information: From Certain Answers to Certain Predictions	2021	VLDB	9.0668832e-05
4,967	Leva: Boosting Machine Learning Performance with Relational Embedding Data Augmentation	2022	SIGMOD	5.7956612e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
10,316	LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning	2026	VLDB	4.1945683e-05
8,257	Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines	2023	SIGMOD	4.5487511e-05
10,598	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	4.1945683e-05
5,963	Automatic Data Acquisition for Deep Learning	2021	VLDB	5.2526794e-05
11,549	Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop	2020	CIDR	4.1945683e-05
5,304	A Scalable AutoML Approach Based on Graph Neural Networks	2022	VLDB	5.5779335e-05
8,743	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.456315e-05
8,828	HAIPipe: Combining Human-generated and Machine-generated Pipelines for Data Preparation	2023	SIGMOD	4.4407488e-05
5,383	Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search	2021	VLDB	5.5393038e-05
3,698	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8340435e-05