DBScholar

Back to papers

RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation

Summary: RPT: denoising tuple-to-tuple autoencoder; Transformer encoder-decoder unifies BERT and GPT. Pre-trained, it enables data cleaning, auto-completion, and normalization and annotation, plus few-shot and collaborative ER/IE. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h7de04480730aa2b9
Venue
VLDB
Year
2021
Pagerank
9.2348951e-05
Overall Rank
1,993 | 86.61%
DOI
10.14778/3457390.3457391
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{tang_vldb21,
        title = {{RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation}},
        author = {Tang, Nan and Fan, Ju and Li, Fangyi and Tu, Jianhong and Du, Xiaoyong and Li, Guoliang and Madden, Sam and Ouzzani, Mourad},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {8},
        pages = {1254--1261},
        doi = {10.14778/3457390.3457391},
        url = {https://doi.org/10.14778/3457390.3457391},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,387 Symphony: Towards Natural Language Query Answering over Multi-modal Data Lakes 2023 CIDR 0.00010829741
1,778 Annotating Columns with Pre-trained Language Models 2022 SIGMOD 9.6578031e-05
1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.2801545e-05
2,378 DeepJoin: Joinable Table Discovery with Pre-trained Language Models 2023 VLDB 8.5495442e-05
4,346 Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs 2024 VLDB 6.646096e-05
4,444 From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management 2022 VLDB 6.5957098e-05
4,631 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB 6.4926848e-05
4,727 LLM for Data Management 2024 VLDB 6.4461562e-05
5,322 Observatory: Characterizing Embeddings of Relational Tables 2024 VLDB 6.1809951e-05
5,362 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1592249e-05
5,645 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 6.0509471e-05
5,686 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 6.0347166e-05
5,815 Domain Adaptation for Deep Entity Resolution 2022 SIGMOD 5.9824897e-05
6,072 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8936535e-05
6,684 Controllable Tabular Data Synthesis Using Diffusion Models 2024 SIGMOD 5.70774e-05
6,924 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.6405901e-05
7,070 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.6056639e-05
7,072 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.6053987e-05
7,589 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.4880216e-05
7,933 TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations 2025 VLDB 5.4228804e-05
8,021 Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models 2024 VLDB 5.4041713e-05
8,236 Adda: Towards Efficient in-Database Feature Generation via LLM-based Agents 2025 SIGMOD 5.3698248e-05
8,329 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 5.3520477e-05
9,623 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 5.1486163e-05
10,116 Data Augmentation for ML-driven Data Preparation and Integration 2021 VLDB 5.0765311e-05
11,278 Weak-to-Strong Prompts with Lightweight-to-Powerful LLMs for High-Accuracy, Low-Cost, and Explainable Data Transformation 2025 VLDB 4.9769913e-05
11,860 OpenTFV: An Open Domain Table-Based Fact Verification System 2022 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
104 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033676943
134 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00030042569
158 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00028038831
188 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00025861123
350 Discovering Denial Constraints 2013 VLDB 0.00020244085
377 TURL: Table Understanding through Representation Learning 2021 VLDB 0.00019564011
457 Distributed Representations of Tuples for Entity Resolution 2018 VLDB 0.00017899824
530 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00016847532
652 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015114401
716 Guided Data Repair 2011 VLDB 0.00014546968
972 The Data Civilizer System 2017 CIDR 0.00012757732
989 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.00012647631
1,098 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012031983
1,342 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010963254
1,344 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00010951939
1,391 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010812249
1,805 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 9.5938877e-05
2,057 Combining Quantitative and Logical Data Cleaning 2016 VLDB 9.1086574e-05
2,192 Data Integration: After the Teenage Years 2017 PODS 8.8826744e-05
2,325 ZeroER: Entity Resolution using Zero Labeled Examples 2020 SIGMOD 8.6308459e-05
2,967 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.8016942e-05
4,825 Automatic Rule Refinement for Information Extraction 2010 VLDB 6.3907162e-05
4,845 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 6.3808938e-05
8,963 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.2486059e-05
Previous Page 1 / 1 Next

Semantically Similar Papers