HAIPipe: Combining Human-generated and Machine-generated Pipelines for Data Preparation

Summary: HAIPipe fuses HI-pipelines with AI-pipelines to form HAI-pipelines that outperform either. It uses an enumeration-sampling framework and RL-guided AI-pipeline search, with experiments on 1400+ real-world HI-pipelines showing gains. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6594
Venue: SIGMOD
Year: 2023
Pagerank: 4.4407488e-05
Overall Rank: 8,828 | 38.59%
DOI: 10.1145/3588945

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,765	Automatic Database Configuration Debugging using Retrieval-Augmented Language Models	2025	SIGMOD	4.9325583e-05
7,931	In-depth Analysis of Graph-based RAG in a Unified Framework	2025	VLDB	4.613363e-05
8,743	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.456315e-05
9,371	Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations	2024	SIGMOD	4.3480692e-05
10,682	AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
921	Democratizing Data Science through Interactive Curation of ML Pipelines	2019	SIGMOD	0.00015337438
1,391	Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloads	2018	VLDB	0.0001223506
1,993	Automatically Generating Data Exploration Sessions Using Deep Reinforcement Learning	2020	SIGMOD	9.8453334e-05
3,252	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	7.3178277e-05
5,383	Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search	2021	VLDB	5.5393038e-05
6,569	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	5.0065379e-05
8,406	DADER: Hands-Off Entity Resolution with Domain Adaptation	2022	VLDB	4.5220083e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,098	Demonstrating CatDB: LLM-based Generation of Data-centric ML Pipelines	2025	SIGMOD	-
8,114	mlwhatif: What If You Could Stop Re-Implementing Your Machine Learning Pipeline Analyses Over and Over?	2023	VLDB	4.5823351e-05
3,698	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8340435e-05
3,970	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.5784767e-05
8,257	Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines	2023	SIGMOD	4.5487511e-05
5,429	DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data	2023	SIGMOD	5.5087325e-05
5,304	A Scalable AutoML Approach Based on Graph Neural Networks	2022	VLDB	5.5779335e-05
11,549	Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop	2020	CIDR	4.1945683e-05
8,743	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.456315e-05
5,383	Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search	2021	VLDB	5.5393038e-05