DBScholar

Back to papers

RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation

Summary: RPT: denoising tuple-to-tuple autoencoder; Transformer encoder-decoder unifies BERT and GPT. Pre-trained, it enables data cleaning, auto-completion, and normalization and annotation, plus few-shot and collaborative ER/IE. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
12503
Venue
VLDB
Year
2021
Pagerank
9.2983994e-05
Overall Rank
2,019 | 86.15%
DOI
10.14778/3457390.3457391

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{tang_vldb21,
        title = {{RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation}},
        author = {Tang, Nan and Fan, Ju and Li, Fangyi and Tu, Jianhong and Du, Xiaoyong and Li, Guoliang and Madden, Sam and Ouzzani, Mourad},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {8},
        pages = {1254--1261},
        doi = {10.14778/3457390.3457391},
        url = {https://doi.org/10.14778/3457390.3457391},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,550 Symphony: Towards Natural Language Query Answering over Multi-modal Data Lakes 2023 CIDR 0.00010385904
1,923 Annotating Columns with Pre-trained Language Models 2022 SIGMOD 9.4789109e-05
2,521 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 8.4729505e-05
3,073 DeepJoin: Joinable Table Discovery with Pre-trained Language Models 2023 VLDB 7.785842e-05
4,449 From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management 2022 VLDB 6.697553e-05
4,836 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB 6.4848269e-05
4,886 Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs 2024 VLDB 6.4614955e-05
5,354 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.2515841e-05
5,518 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 6.1885722e-05
5,730 Domain Adaptation for Deep Entity Resolution 2022 SIGMOD 6.1071585e-05
5,816 Observatory: Characterizing Embeddings of Relational Tables 2024 VLDB 6.0776454e-05
6,101 LLM for Data Management 2024 VLDB 5.9774273e-05
6,378 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8929835e-05
6,545 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 5.8454882e-05
6,555 Controllable Tabular Data Synthesis Using Diffusion Models 2024 SIGMOD 5.8415111e-05
6,928 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.7370426e-05
6,997 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.7300324e-05
7,865 Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models 2024 VLDB 5.5282752e-05
8,197 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 5.4691464e-05
8,914 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.3483178e-05
9,155 Adda: Towards Efficient in-Database Feature Generation via LLM-based Agents 2025 SIGMOD 5.3122817e-05
9,437 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 5.2687567e-05
9,505 TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations 2025 VLDB 5.258497e-05
9,550 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.2528121e-05
9,930 Data Augmentation for ML-driven Data Preparation and Integration 2021 VLDB 5.1955087e-05
10,867 Weak-to-Strong Prompts with Lightweight-to-Powerful LLMs for High-Accuracy, Low-Cost, and Explainable Data Transformation 2025 VLDB 5.093636e-05
11,545 OpenTFV: An Open Domain Table-Based Fact Verification System 2022 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
112 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00032801121
141 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.0002964847
176 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00027191081
185 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00026231189
376 Discovering Denial Constraints 2013 VLDB 0.00019677674
397 TURL: Table Understanding through Representation Learning 2021 VLDB 0.00019278189
489 Distributed Representations of Tuples for Entity Resolution 2018 VLDB 0.0001761456
529 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00017096361
661 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.0001519162
714 Guided Data Repair 2011 VLDB 0.00014662041
963 The Data Civilizer System 2017 CIDR 0.00012935145
998 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.0001275238
1,101 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012168934
1,351 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00011064851
1,402 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010888094
1,476 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010659277
2,041 Combining Quantitative and Logical Data Cleaning 2016 VLDB 9.2692538e-05
2,169 Data Integration: After the Teenage Years 2017 PODS 9.0436759e-05
2,290 ZeroER: Entity Resolution using Zero Labeled Examples 2020 SIGMOD 8.799251e-05
2,297 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 8.7897221e-05
2,981 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.8960114e-05
4,752 Automatic Rule Refinement for Information Extraction 2010 VLDB 6.5235308e-05
4,757 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 6.5220005e-05
8,807 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.3671183e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,746 Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop 2020 CIDR
2 9,380 Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence 2025 VLDB
3 11,083 Graph Transformers for Query Plan Representation: Potentials and Challenges 2025 VLDB
4 2,099 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD
5 10,202 BAT: Target-Instance-Free Data Preparation Synthesis via LLM-Driven Tree Search 2026 SIGMOD
6 10,614 LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning 2026 VLDB
7 4,836 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB
8 10,931 AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework 2025 VLDB
9 4,412 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB
10 6,545 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD