HAIPipe: Combining Human-generated and Machine-generated Pipelines for Data Preparation

Summary: HAIPipe fuses HI-pipelines with AI-pipelines to form HAI-pipelines that outperform either. It uses an enumeration-sampling framework and RL-guided AI-pipeline search, with experiments on 1400+ real-world HI-pipelines showing gains. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6595
Venue: SIGMOD
Year: 2023
Pagerank: 4.4364918e-05
Overall Rank: 8,828 | 38.65%
DOI: 10.1145/3588945

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,564	Automatic Database Configuration Debugging using Retrieval-Augmented Language Models	2025	SIGMOD	5.0037892e-05
7,933	In-depth Analysis of Graph-based RAG in a Unified Framework	2025	VLDB	4.6089395e-05
8,739	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.4520434e-05
9,381	Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations	2024	SIGMOD	4.343902e-05
10,690	AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
917	Democratizing Data Science through Interactive Curation of ML Pipelines	2019	SIGMOD	0.00015324193
1,393	Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloads	2018	VLDB	0.00012223372
1,992	Automatically Generating Data Exploration Sessions Using Deep Reinforcement Learning	2020	SIGMOD	9.8415851e-05
3,254	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	7.3172324e-05
5,389	Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search	2021	VLDB	5.5339832e-05
6,570	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	5.0017341e-05
8,401	DADER: Hands-Off Entity Resolution with Domain Adaptation	2022	VLDB	4.5176737e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,112	Demonstrating CatDB: LLM-based Generation of Data-centric ML Pipelines	2025	SIGMOD	-
8,119	mlwhatif: What If You Could Stop Re-Implementing Your Machine Learning Pipeline Analyses Over and Over?	2023	VLDB	4.5779426e-05
3,694	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8316905e-05
3,973	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.5721521e-05
8,253	Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines	2023	SIGMOD	4.5444167e-05
5,439	DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data	2023	SIGMOD	5.5034427e-05
5,306	A Scalable AutoML Approach Based on Graph Neural Networks	2022	VLDB	5.5725759e-05
11,553	Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop	2020	CIDR	4.1905499e-05
8,739	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	4.4520434e-05
5,389	Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search	2021	VLDB	5.5339832e-05