DBScholar

Back to papers

From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management

Summary: Survey of very large language models (VLLMs) for data management, detailing usage in DB tasks with minimal fine-tuning. Explores Codex-style code generation, libraries/APIs, and LM-based architectures and integration with traditional systems. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf3dbc53009b80884
Venue
VLDB
Year
2022
Pagerank
6.5957098e-05
Overall Rank
4,444 | 70.14%
DOI
10.14778/3554821.3554896
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{trummer_vldb22,
        title = {{From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management}},
        author = {Trummer, Immanuel},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3770--3773},
        doi = {10.14778/3554821.3554896},
        url = {https://doi.org/10.14778/3554821.3554896},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank Citing Paper Year Venue Pagerank
4,352 Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity 2024 VLDB 6.6396584e-05
5,362 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1592249e-05
5,542 Pre-trained Embeddings for Entity Resolution: An Experimental Analysis 2023 VLDB 6.0878758e-05
6,072 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8936535e-05
7,072 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.6053987e-05
7,773 DBG-PT: A Large Language Model Assisted Query Performance Regression Debugger 2024 VLDB 5.4539148e-05
9,118 Generation of Training Examples for Tabular Natural Language Inference 2023 SIGMOD 5.2255715e-05
9,498 LLM-PBE: Assessing Data Privacy in Large Language Models 2024 VLDB 5.168414e-05
10,219 A Universal Question-Answering Platform for Knowledge Graphs 2023 SIGMOD 5.0572653e-05
11,429 Large Language Models for Spatial Analysis Queries 2025 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
536 NaLIR: An Interactive Natural Language Interface for Querying Relational Databases 2014 SIGMOD 0.00016774383
1,245 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.0001136308
1,840 From Natural Language Processing to Neural Databases 2021 VLDB 9.5271706e-05
1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.2801545e-05
1,993 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2348951e-05
2,908 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.8716173e-05
3,284 A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems 2021 SIGMOD 7.4528361e-05
3,521 Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins 2022 VLDB 7.2320843e-05
4,743 Machine Learning for Databases 2021 VLDB 6.4379536e-05
5,123 State of the Art and Open Challenges in Natural Language Interfaces to Data 2020 SIGMOD 6.2621573e-05
5,509 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.0987831e-05
5,969 Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems 2019 VLDB 5.9296488e-05
6,081 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD 5.8897947e-05
7,813 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4474823e-05
8,487 Deep Learning: Systems and Responsibility 2021 SIGMOD 5.3306164e-05
9,468 TextCube: Automated Construction and Multidimensional Exploration 2019 VLDB 5.1709828e-05
9,469 Combating Fake News: A Data Management and Mining Perspective 2019 VLDB 5.1709828e-05
11,896 BABOONS: Black-Box Optimization of Data Summaries in Natural Language 2022 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB
2 9,167 Database Perspective on LLM Inference Systems 2025 VLDB
3 1,223 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD
4 9,582 Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Models 2024 VLDB
5 6,387 Natural Language Interfaces for Databases with Deep Learning 2023 VLDB
6 4,631 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB
7 13,696 Harmonizing ML and Databases: A Symphony of Data (VLDB 2024 Keynote) 2024 VLDB
8 4,727 LLM for Data Management 2024 VLDB
9 3,236 How Large Language Models Will Disrupt Data Management 2023 VLDB
10 5,231 Natural Language Data Management and Interfaces: Recent Development and Open Challenges 2017 SIGMOD