Transformers for Tabular Data Representation: A Tutorial on Models and Applications

Summary: Tutorial surveying transformer-based representations for tabular data, detailing how LMs adapt to relational tables and modeling limits. Outlines data-management applications and a call for DB researchers to engage with tabular transformers. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h344ba19949854e14
Venue: VLDB
Year: 2022
Pagerank: 6.4953891e-05
Overall Rank: 4,630 | 68.88%
DOI: 10.14778/3554821.3554890

Incoming Non-self Citations Over Time

Authors

1. Gilbert Badaro (EURECOM)
2. Paolo Papotti (EURECOM)

BibTeX Citation

@article{badaro_vldb22,
        title = {{Transformers for Tabular Data Representation: A Tutorial on Models and Applications}},
        author = {Badaro, Gilbert and Papotti, Paolo},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3746--3749},
        doi = {10.14778/3554821.3554890},
        url = {https://doi.org/10.14778/3554821.3554890},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,743	Logical and Physical Optimizations for SQL Query Execution over Large Language Models	2025	SIGMOD	7.0586112e-05
4,218	Magneto: Combining Small and Large Language Models for Schema Matching	2025	VLDB	6.7270169e-05
5,332	Observatory: Characterizing Embeddings of Relational Tables	2024	VLDB	6.1766186e-05
5,687	DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models	2024	SIGMOD	6.0360406e-05
8,574	OmniMatch: Joinability Discovery in Data Products	2025	VLDB	5.312217e-05
8,988	Watchog: A Light-weight Contrastive Learning based Framework for Column Annotation	2023	SIGMOD	5.2425067e-05
9,109	Generation of Training Examples for Tabular Natural Language Inference	2023	SIGMOD	5.2280464e-05
10,816	FedAugment: Table Augmentation Search over Decentralized Data Repositories	2026	VLDB	4.9793485e-05
11,200	Table Overlap Estimation through Graph Embeddings	2025	SIGMOD	4.9793485e-05
11,256	Birdie: Natural Language-Driven Table Discovery Using Differentiable Search Index	2025	VLDB	4.9793485e-05
11,423	Large Language Models for Spatial Analysis Queries	2025	VLDB	4.9793485e-05
11,427	Panel on Neural Relational Data: Tabular Foundation Models, LLMs... or both?	2025	VLDB	4.9793485e-05
11,512	Determining the Largest Overlap between Tables	2024	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
134	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.00030043481
377	TURL: Table Understanding through Representation Learning	2021	VLDB	0.00019570264
1,391	Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks	2020	SIGMOD	0.00010816237
1,780	Annotating Columns with Pre-trained Language Models	2022	SIGMOD	9.6560923e-05
1,991	RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation	2021	VLDB	9.2383849e-05
3,282	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD	7.4563046e-05
11,855	Pythia: Unsupervised Generation of Ambiguous Textual Claims from Relational Data	2022	SIGMOD	4.9793485e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,956	Graph Transformers for Query Plan Representation: Potentials and Challenges	2025	VLDB
2	7,554	Table Extraction and Understanding for Scientific and Enterprise Applications	2020	VLDB
3	5,227	Natural Language Data Management and Interfaces: Recent Development and Open Challenges	2017	SIGMOD
4	9,210	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB
5	5,120	State of the Art and Open Challenges in Natural Language Interfaces to Data	2020	SIGMOD
6	7,928	TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations	2025	VLDB
7	5,687	DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models	2024	SIGMOD
8	6,384	Natural Language Interfaces for Databases with Deep Learning	2023	VLDB
9	3,282	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD
10	1,846	From Natural Language Processing to Neural Databases	2021	VLDB