DBScholar

Back to papers

Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence

Summary: Auto-Prep jointly predicts data transformations and joins for self-service BI, recognizing their interdependence and modeling workflows via a Steiner-tree-inspired graph algorithm with quality guarantees. On ~2K real projects, it predicts over 70% of steps, outperforming prior methods and GPT-4. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hd8f394d76e69f73a
Venue
VLDB
Year
2025
Pagerank
5.4994676e-05
Overall Rank
7,531 | 49.39%
DOI
10.14778/3734839.3734856
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{lai_vldb25,
        title = {{Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence}},
        author = {Lai, Eugenie Y. and He, Yeye and Chaudhuri, Surajit},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {14},
        number = {7},
        pages = {2212--2225},
        doi = {10.14778/3734839.3734856},
        url = {https://doi.org/10.14778/3734839.3734856},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank Citing Paper Year Venue Pagerank
10,430 BAT: Target-Instance-Free Data Preparation Synthesis via LLM-Driven Tree Search 2026 SIGMOD 4.9769913e-05
10,847 EcoTable: Cost-effective Table Integration in Data Lakes for Natural Language Queries 2026 VLDB 4.9769913e-05
10,878 DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation 2026 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
329 Can Foundation Models Wrangle Your Data? 2023 VLDB 0.00020867521
519 Query by Output 2009 SIGMOD 0.00016937515
694 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014721161
884 HoloDetect: Few-Shot Learning for Error Detection 2019 SIGMOD 0.00013263269
1,095 BlinkFill: Semi-supervised Programming By Example for Syntactic String Transformations 2016 VLDB 0.00012048043
1,115 Foofah: Transforming Data By Example 2017 SIGMOD 0.00011958625
1,342 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010963254
1,533 On Multi-Column Foreign Key Discovery 2010 VLDB 0.00010328081
1,805 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 9.5938877e-05
1,977 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 9.2760522e-05
2,372 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5575299e-05
2,613 Auto-Join: Joining Tables by Leveraging Transformations 2017 VLDB 8.2229082e-05
2,744 Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations 2018 VLDB 8.064168e-05
2,748 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0572603e-05
2,933 OLAP and Statistical Databases: Similarities and Differences 1997 PODS 7.8366447e-05
2,962 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.8038782e-05
3,100 Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflows 2022 VLDB 7.64814e-05
4,204 SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora 2015 VLDB 6.7331936e-05
4,235 Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search 2021 VLDB 6.710043e-05
4,426 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.601896e-05
4,972 Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples 2021 SIGMOD 6.3300201e-05
5,138 Fast Foreign-Key Detection in Microsoft SQL Server PowerPivot for Excel 2014 VLDB 6.2561301e-05
5,168 Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examples 2023 VLDB 6.2432932e-05
5,686 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 6.0347166e-05
7,150 Transform-Data-by-Example (TDE): Extensible Data Transformation in Excel 2018 SIGMOD 5.5963926e-05
7,933 TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations 2025 VLDB 5.4228804e-05
8,989 Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema Graph 2023 VLDB 5.2418732e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,525 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD
2 12,055 Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop 2020 CIDR
3 10,878 DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation 2026 VLDB
4 5,168 Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examples 2023 VLDB
5 2,613 Auto-Join: Joining Tables by Leveraging Transformations 2017 VLDB
6 7,273 AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework 2025 VLDB
7 4,426 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB
8 4,235 Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search 2021 VLDB
9 2,642 Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks 2020 SIGMOD
10 8,989 Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema Graph 2023 VLDB