DBScholar

Back to papers

RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation

Summary: RPT: denoising tuple-to-tuple autoencoder; Transformer encoder-decoder unifies BERT and GPT. Pre-trained, it enables data cleaning, auto-completion, and normalization and annotation, plus few-shot and collaborative ER/IE. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h7de04480730aa2b9
Venue
VLDB
Year
2021
Pagerank
9.2224853e-05
Overall Rank
1,993 | 86.65%
DOI
10.14778/3457390.3457391
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{tang_vldb21,
        title = {{RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation}},
        author = {Tang, Nan and Fan, Ju and Li, Fangyi and Tu, Jianhong and Du, Xiaoyong and Li, Guoliang and Madden, Sam and Ouzzani, Mourad},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {8},
        pages = {1254--1261},
        doi = {10.14778/3457390.3457391},
        url = {https://doi.org/10.14778/3457390.3457391},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,358 Symphony: Towards Natural Language Query Answering over Multi-modal Data Lakes 2023 CIDR 0.00010902306
1,690 Annotating Columns with Pre-trained Language Models 2022 SIGMOD 9.8426663e-05
1,931 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.3449634e-05
2,370 DeepJoin: Joinable Table Discovery with Pre-trained Language Models 2023 VLDB 8.5469172e-05
4,351 Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs 2024 VLDB 6.634024e-05
4,464 From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management 2022 VLDB 6.5747093e-05
4,611 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB 6.4869956e-05
4,729 LLM for Data Management 2024 VLDB 6.4317927e-05
5,301 Observatory: Characterizing Embeddings of Relational Tables 2024 VLDB 6.1761723e-05
5,377 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1396287e-05
5,654 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 6.0324041e-05
5,658 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 6.0309825e-05
5,830 Domain Adaptation for Deep Entity Resolution 2022 SIGMOD 5.9627079e-05
6,085 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8745517e-05
6,438 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.7678369e-05
6,698 Controllable Tabular Data Synthesis Using Diffusion Models 2024 SIGMOD 5.6888667e-05
7,076 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.5909675e-05
7,092 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.5868637e-05
7,606 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.4698748e-05
7,946 TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations 2025 VLDB 5.404949e-05
8,037 Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models 2024 VLDB 5.3863017e-05
8,255 Adda: Towards Efficient in-Database Feature Generation via LLM-based Agents 2025 SIGMOD 5.3520689e-05
8,327 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 5.3381899e-05
9,634 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 5.1354312e-05
10,153 Data Augmentation for ML-driven Data Preparation and Integration 2021 VLDB 5.0597449e-05
11,334 Weak-to-Strong Prompts with Lightweight-to-Powerful LLMs for High-Accuracy, Low-Cost, and Explainable Data Transformation 2025 VLDB 4.9605343e-05
11,904 OpenTFV: An Open Domain Table-Based Fact Verification System 2022 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
100 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033951027
132 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00030213215
158 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00028049555
190 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00025812169
348 Discovering Denial Constraints 2013 VLDB 0.00020216677
366 TURL: Table Understanding through Representation Learning 2021 VLDB 0.00019902067
459 Distributed Representations of Tuples for Entity Resolution 2018 VLDB 0.00017863654
517 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00016946929
652 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015117165
717 Guided Data Repair 2011 VLDB 0.00014531658
972 The Data Civilizer System 2017 CIDR 0.00012742827
988 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.00012643318
1,099 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012008783
1,306 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00011076619
1,347 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010947547
1,348 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010943046
1,731 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 9.7585913e-05
2,056 Combining Quantitative and Logical Data Cleaning 2016 VLDB 9.10022e-05
2,200 Data Integration: After the Teenage Years 2017 PODS 8.8631564e-05
2,271 ZeroER: Entity Resolution using Zero Labeled Examples 2020 SIGMOD 8.7110698e-05
2,958 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.7991971e-05
4,538 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 6.5398994e-05
4,847 Automatic Rule Refinement for Information Extraction 2010 VLDB 6.3701399e-05
8,982 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.2317838e-05
Previous Page 1 / 1 Next

Semantically Similar Papers