DBScholar

Back to papers

From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management

Summary: Survey of very large language models (VLLMs) for data management, detailing usage in DB tasks with minimal fine-tuning. Explores Codex-style code generation, libraries/APIs, and LM-based architectures and integration with traditional systems. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf3dbc53009b80884
Venue
VLDB
Year
2022
Pagerank
6.5747093e-05
Overall Rank
4,464 | 70.08%
DOI
10.14778/3554821.3554896
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{trummer_vldb22,
        title = {{From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management}},
        author = {Trummer, Immanuel},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3770--3773},
        doi = {10.14778/3554821.3554896},
        url = {https://doi.org/10.14778/3554821.3554896},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank Citing Paper Year Venue Pagerank
4,360 Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity 2024 VLDB 6.6274323e-05
5,377 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1396287e-05
5,539 Pre-trained Embeddings for Entity Resolution: An Experimental Analysis 2023 VLDB 6.0745352e-05
6,085 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8745517e-05
7,092 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.5868637e-05
7,768 DBG-PT: A Large Language Model Assisted Query Performance Regression Debugger 2024 VLDB 5.4392507e-05
9,073 Generation of Training Examples for Tabular Natural Language Inference 2023 SIGMOD 5.2117663e-05
9,527 LLM-PBE: Assessing Data Privacy in Large Language Models 2024 VLDB 5.151324e-05
10,255 A Universal Question-Answering Platform for Knowledge Graphs 2023 SIGMOD 5.0405429e-05
11,482 Large Language Models for Spatial Analysis Queries 2025 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
523 NaLIR: An Interactive Natural Language Interface for Querying Relational Databases 2014 SIGMOD 0.0001689006
1,238 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011375179
1,815 From Natural Language Processing to Neural Databases 2021 VLDB 9.5644373e-05
1,931 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.3449634e-05
1,993 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2224853e-05
2,913 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.855786e-05
3,246 A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems 2021 SIGMOD 7.4779968e-05
3,524 Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins 2022 VLDB 7.215969e-05
4,765 Machine Learning for Databases 2021 VLDB 6.4166895e-05
5,143 State of the Art and Open Challenges in Natural Language Interfaces to Data 2020 SIGMOD 6.2414745e-05
5,531 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.0786523e-05
5,979 Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems 2019 VLDB 5.910201e-05
6,095 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD 5.8706416e-05
7,830 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4294933e-05
8,502 Deep Learning: Systems and Responsibility 2021 SIGMOD 5.3130138e-05
9,498 TextCube: Automated Construction and Multidimensional Exploration 2019 VLDB 5.1539081e-05
9,499 Combating Fake News: A Data Management and Mining Perspective 2019 VLDB 5.1539081e-05
11,940 BABOONS: Black-Box Optimization of Data Summaries in Natural Language 2022 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,931 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB
2 9,191 Database Perspective on LLM Inference Systems 2025 VLDB
3 1,226 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD
4 9,607 Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Models 2024 VLDB
5 6,328 Natural Language Interfaces for Databases with Deep Learning 2023 VLDB
6 4,611 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB
7 13,736 Harmonizing ML and Databases: A Symphony of Data (VLDB 2024 Keynote) 2024 VLDB
8 4,729 LLM for Data Management 2024 VLDB
9 3,223 How Large Language Models Will Disrupt Data Management 2023 VLDB
10 5,251 Natural Language Data Management and Interfaces: Recent Development and Open Challenges 2017 SIGMOD