Back to papers
Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks
Summary: Auto-Suggest learns to propose data prep steps by mining notebook-driven data manipulations. Crawls 4M GitHub Jupyter notebooks, replays steps to log inputs/outputs and decisions, using logs to learn data-driven prep recommendations that beat baselines.
(summarized by gpt-5-nano on Feb 09 2026)
- Paper ID
- 5954
- Venue
- SIGMOD
- Year
- 2020
- Pagerank
- 7.3172324e-05
- Overall Rank
- 3,254 | 77.39%
- DOI
-
10.1145/3318464.3389738
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 17 of 17 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
| 3,003 |
Chorus: Foundation Models for Unified Data Discovery and Exploration |
2024 |
VLDB |
7.7358219e-05 |
| 5,279 |
Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examples |
2023 |
VLDB |
5.5851818e-05 |
| 5,283 |
Explaining Dataset Changes for Semantic Data Versioning with Explain-Da-V |
2023 |
VLDB |
5.5843052e-05 |
| 5,389 |
Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search |
2021 |
VLDB |
5.5339832e-05 |
| 6,405 |
Fine-Grained Lineage for Safer Notebook Interactions |
2021 |
VLDB |
5.0707934e-05 |
| 6,898 |
Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine |
2025 |
VLDB |
4.8878659e-05 |
| 8,388 |
FEDEX: An Explainability Framework for Data Exploration Steps |
2022 |
VLDB |
4.525436e-05 |
| 8,625 |
Predicate Pushdown for Data Science Pipelines |
2023 |
SIGMOD |
4.4784651e-05 |
| 8,828 |
HAIPipe: Combining Human-generated and Machine-generated Pipelines for Data Preparation |
2023 |
SIGMOD |
4.4364918e-05 |
| 9,381 |
Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations |
2024 |
SIGMOD |
4.343902e-05 |
| 9,491 |
Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema Graph |
2023 |
VLDB |
4.3300131e-05 |
| 10,152 |
Data-Semantics-Aware Recommendation of Diverse Pivot Tables |
2026 |
SIGMOD |
4.1905499e-05 |
| 10,168 |
FlowPilot: A Suggestion System for Designing Scientific Workflows |
2026 |
SIGMOD |
4.1905499e-05 |
| 11,066 |
Searching Data Lakes for Nested and Joined Data |
2024 |
VLDB |
4.1905499e-05 |
| 11,106 |
LucidScript: Bottom-up Standardization for Data Preparation |
2024 |
VLDB |
4.1905499e-05 |
| 11,299 |
DataRinse: Semantic Transforms for Data preparation based on Code Mining |
2023 |
VLDB |
4.1905499e-05 |
| 11,432 |
Leam: An Interactive System for In-situ Visual Text Analysis |
2021 |
CIDR |
4.1905499e-05 |
Outgoing Citations (Sorted by Pagerank)
Showing 25 of 25 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 99 |
XMark: A Benchmark for XML Data Management |
2002 |
VLDB |
0.00050043993 |
| 481 |
Mining Database Structure; Or, How to Build a Data Quality Browser |
2002 |
SIGMOD |
0.000221538 |
| 601 |
Linear Road: A Stream Data Management Benchmark |
2004 |
VLDB |
0.00019372971 |
| 1,010 |
SnipSuggest: Context-Aware Autocompletion for SQL |
2011 |
VLDB |
0.00014644808 |
| 1,266 |
Foofah: Transforming Data By Example |
2017 |
SIGMOD |
0.00012921038 |
| 1,274 |
The Data Civilizer System |
2017 |
CIDR |
0.00012869297 |
| 1,316 |
Harvesting Relational Tables from Lists on the Web |
2009 |
VLDB |
0.00012616422 |
| 1,340 |
HoloDetect: Few-Shot Learning for Error Detection |
2019 |
SIGMOD |
0.00012492795 |
| 1,403 |
Detecting Data Errors: Where are we and what needs to be done? |
2016 |
VLDB |
0.00012180046 |
| 1,469 |
BlinkFill: Semi-supervised Programming By Example for Syntactic String Transformations |
2016 |
VLDB |
0.00011831156 |
| 1,481 |
Automating Large-Scale Data Quality Verification |
2018 |
VLDB |
0.00011715754 |
| 1,661 |
On Multi-Column Foreign Key Discovery |
2010 |
VLDB |
0.00010967185 |
| 2,100 |
Predictive Interaction for Data Transformation |
2015 |
CIDR |
9.5410186e-05 |
| 2,161 |
Uni-Detect: A Unified Approach to Automated Error Detection in Tables |
2019 |
SIGMOD |
9.4029915e-05 |
| 2,507 |
Auto-Detect: Data-Driven Error Detection in Tables |
2018 |
SIGMOD |
8.6254741e-05 |
| 3,303 |
SCODED: Statistical Constraint Oriented Data Error Detection |
2020 |
SIGMOD |
7.2438671e-05 |
| 3,483 |
Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations |
2018 |
VLDB |
7.0493668e-05 |
| 3,693 |
Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets |
2018 |
SIGMOD |
6.8326441e-05 |
| 3,738 |
Auto-Join: Joining Tables by Leveraging Transformations |
2017 |
VLDB |
6.8006812e-05 |
| 3,745 |
TEGRA: Table Extraction by Global Record Alignment |
2015 |
SIGMOD |
6.7907837e-05 |
| 4,849 |
SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora |
2015 |
VLDB |
5.872093e-05 |
| 5,495 |
Fast Foreign-Key Detection in Microsoft SQL Server PowerPivot for Excel |
2014 |
VLDB |
5.4770205e-05 |
| 6,197 |
WADaR: Joint Wrapper and Data Repair |
2015 |
VLDB |
5.1570343e-05 |
| 6,698 |
The TEXTURE Benchmark: Measuring Performance of Text Queries on a Relational DBMS |
2005 |
VLDB |
4.9534956e-05 |
| 8,497 |
Synthesizing Mapping Relationships Using Table Corpus |
2017 |
SIGMOD |
4.49328e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 4,168 |
Automatic Example Queries for Ad Hoc Databases |
2011 |
SIGMOD |
6.3822979e-05 |
| 11,553 |
Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop |
2020 |
CIDR |
4.1905499e-05 |
| 10,152 |
Data-Semantics-Aware Recommendation of Diverse Pivot Tables |
2026 |
SIGMOD |
4.1905499e-05 |
| 10,690 |
AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework |
2025 |
VLDB |
4.1905499e-05 |
| 9,491 |
Auto-BI: Automatically Build BI-Models Leveraging Local Join Prediction and Global Schema Graph |
2023 |
VLDB |
4.3300131e-05 |
| 5,096 |
Auto-Transform: Learning-to-Transform by Patterns |
2020 |
VLDB |
5.6960764e-05 |
| 1,643 |
Finding Related Tables in Data Lakes for Interactive Data Science |
2020 |
SIGMOD |
0.00011031534 |
| 13,304 |
Towards Understanding Data Analysis Workflows using a Large Notebook Corpus |
2019 |
SIGMOD |
- |
| 5,389 |
Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search |
2021 |
VLDB |
5.5339832e-05 |
| 10,606 |
Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence |
2025 |
VLDB |
4.1905499e-05 |