Transformers for Tabular Data Representation: A Tutorial on Models and Applications

Summary: Tutorial surveying transformer-based representations for tabular data, detailing how LMs adapt to relational tables and modeling limits. Outlines data-management applications and a call for DB researchers to engage with tabular transformers. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 13066
Venue: VLDB
Year: 2022
Pagerank: 6.4848269e-05
Overall Rank: 4,836 | 66.83%
DOI: 10.14778/3554821.3554890

Incoming Non-self Citations Over Time

Authors

1. Gilbert Badaro (EURECOM)
2. Paolo Papotti (EURECOM)

BibTeX Citation

@article{badaro_vldb22,
        title = {{Transformers for Tabular Data Representation: A Tutorial on Models and Applications}},
        author = {Badaro, Gilbert and Papotti, Paolo},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3746--3749},
        doi = {10.14778/3554821.3554890},
        url = {https://doi.org/10.14778/3554821.3554890},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,045	Logical and Physical Optimizations for SQL Query Execution over Large Language Models	2025	SIGMOD	6.9394654e-05
5,293	Magneto: Combining Small and Large Language Models for Schema Matching	2025	VLDB	6.279939e-05
5,816	Observatory: Characterizing Embeddings of Relational Tables	2024	VLDB	6.0776454e-05
6,545	DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models	2024	SIGMOD	5.8454882e-05
8,860	Watchog: A Light-weight Contrastive Learning based Framework for Column Annotation	2023	SIGMOD	5.3564029e-05
8,945	Generation of Training Examples for Tabular Natural Language Inference	2023	SIGMOD	5.3480421e-05
10,783	Table Overlap Estimation through Graph Embeddings	2025	SIGMOD	5.093636e-05
10,850	Birdie: Natural Language-Driven Table Discovery Using Differentiable Search Index	2025	VLDB	5.093636e-05
10,987	OmniMatch: Joinability Discovery in Data Products	2025	VLDB	5.093636e-05
11,061	Large Language Models for Spatial Analysis Queries	2025	VLDB	5.093636e-05
11,068	Panel on Neural Relational Data: Tabular Foundation Models, LLMs... or both?	2025	VLDB	5.093636e-05
11,167	Determining the Largest Overlap between Tables	2024	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
141	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.0002964847
397	TURL: Table Understanding through Representation Learning	2021	VLDB	0.00019278189
1,402	Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks	2020	SIGMOD	0.00010888094
1,923	Annotating Columns with Pre-trained Language Models	2022	SIGMOD	9.4789109e-05
2,019	RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation	2021	VLDB	9.2983994e-05
3,339	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD	7.5047676e-05
11,546	Pythia: Unsupervised Generation of Ambiguous Textual Claims from Relational Data	2022	SIGMOD	5.093636e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,083	Graph Transformers for Query Plan Representation: Potentials and Challenges	2025	VLDB
2	7,482	Table Extraction and Understanding for Scientific and Enterprise Applications	2020	VLDB
3	5,130	Natural Language Data Management and Interfaces: Recent Development and Open Challenges	2017	SIGMOD
4	9,870	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB
5	5,078	State of the Art and Open Challenges in Natural Language Interfaces to Data	2020	SIGMOD
6	9,505	TabulaX: Leveraging Large Language Models for Multi-Class Table Transformations	2025	VLDB
7	6,545	DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models	2024	SIGMOD
8	6,870	Natural Language Interfaces for Databases with Deep Learning	2023	VLDB
9	3,339	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD
10	2,175	From Natural Language Processing to Neural Databases	2021	VLDB