Database Paper Browser

Back to papers

RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation

Summary: RPT: denoising tuple-to-tuple autoencoder; Transformer encoder-decoder unifies BERT and GPT. Pre-trained, it enables data cleaning, auto-completion, and normalization and annotation, plus few-shot and collaborative ER/IE. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
12316
Venue
VLDB
Year
2021
Pagerank
8.9903659e-05
Overall Rank
2,348 | 83.69%
DOI
10.14778/3457390.3457391

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,505 Symphony: Towards Natural Language Query Answering over Multi-modal Data Lakes 2023 CIDR 0.00011601232
1,631 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 0.00011071662
2,513 Annotating Columns with Pre-trained Language Models 2022 SIGMOD 8.6155767e-05
3,326 DeepJoin: Joinable Table Discovery with Pre-trained Language Models 2023 VLDB 7.2148323e-05
4,916 From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management 2022 VLDB 5.827729e-05
5,457 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB 5.4960654e-05
5,506 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 5.4711611e-05
6,071 Observatory: Characterizing Embeddings of Relational Tables 2024 VLDB 5.2231739e-05
6,202 Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs 2024 VLDB 5.1554849e-05
6,279 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 5.1241232e-05
6,552 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.0109216e-05
6,570 Domain Adaptation for Deep Entity Resolution 2022 SIGMOD 5.0017341e-05
6,712 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 4.9474017e-05
6,798 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 4.9186164e-05
7,016 LLM for Data Management 2024 VLDB 4.8561622e-05
7,676 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 4.6770108e-05
8,054 Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models 2024 VLDB 4.5909042e-05
8,207 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 4.5537604e-05
8,522 Controllable Tabular Data Synthesis Using Diffusion Models 2024 SIGMOD 4.4893996e-05
8,739 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 4.4520434e-05
9,354 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 4.3484715e-05
9,405 TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations 2025 VLDB 4.3399748e-05
9,478 Adda: Towards Efficient in-Database Feature Generation via LLM-based Agents 2025 SIGMOD 4.3300131e-05
9,481 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 4.3300131e-05
9,776 Data Augmentation for ML-driven Data Preparation and Integration 2021 VLDB 4.2815042e-05
10,618 Weak-to-Strong Prompts with Lightweight-to-Powerful LLMs for High-Accuracy, Low-Cost, and Explainable Data Transformation 2025 VLDB 4.1905499e-05
11,349 OpenTFV: An Open Domain Table-Based Fact Verification System 2022 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
192 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00035692958
219 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00033354456
268 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00029739054
293 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00028661817
514 TURL: Table Understanding through Representation Learning 2021 VLDB 0.00021280726
556 Discovering Denial Constraints 2013 VLDB 0.00020214701
705 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00017779048
740 Distributed Representations of Tuples for Entity Resolution 2018 VLDB 0.00017358024
830 Guided Data Repair 2011 VLDB 0.00016125759
879 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015649604
1,160 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.0001358129
1,274 The Data Civilizer System 2017 CIDR 0.00012869297
1,403 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00012180046
1,544 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00011438274
1,895 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010174634
1,914 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010111859
2,214 Data Integration: After the Teenage Years 2017 PODS 9.2796408e-05
2,417 Combining Quantitative and Logical Data Cleaning 2016 VLDB 8.8502556e-05
2,968 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 7.7964476e-05
3,057 ZeroER: Entity Resolution using Zero Labeled Examples 2020 SIGMOD 7.6458287e-05
3,198 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.4029546e-05
5,203 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 5.628087e-05
6,527 Automatic Rule Refinement for Information Extraction 2010 VLDB 5.0200332e-05
8,510 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 4.4904732e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
219 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00033354456
11,553 Active Reinforcement Learning for Data Preparation: Learn2Clean with Human-In-The-Loop 2020 CIDR 4.1905499e-05
10,606 Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence 2025 VLDB 4.1905499e-05
10,863 Graph Transformers for Query Plan Representation: Potentials and Challenges 2025 VLDB 4.1905499e-05
2,585 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 8.4909917e-05
10,328 LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning 2026 VLDB 4.1905499e-05
5,457 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB 5.4960654e-05
10,690 AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework 2025 VLDB 4.1905499e-05
5,096 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 5.6960764e-05
6,798 DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models 2024 SIGMOD 4.9186164e-05