DBScholar

Back to papers

From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management

Summary: Survey of very large language models (VLLMs) for data management, detailing usage in DB tasks with minimal fine-tuning. Explores Codex-style code generation, libraries/APIs, and LM-based architectures and integration with traditional systems. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf3dbc53009b80884
Venue
VLDB
Year
2022
Pagerank
6.5988336e-05
Overall Rank
4,442 | 70.14%
DOI
10.14778/3554821.3554896

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{trummer_vldb22,
        title = {{From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management}},
        author = {Trummer, Immanuel},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3770--3773},
        doi = {10.14778/3554821.3554896},
        url = {https://doi.org/10.14778/3554821.3554896},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank Citing Paper Year Venue Pagerank
4,351 Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity 2024 VLDB 6.642803e-05
5,357 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.1619918e-05
5,540 Pre-trained Embeddings for Entity Resolution: An Experimental Analysis 2023 VLDB 6.0907591e-05
6,071 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8962612e-05
7,070 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.6080535e-05
7,764 DBG-PT: A Large Language Model Assisted Query Performance Regression Debugger 2024 VLDB 5.4564979e-05
9,109 Generation of Training Examples for Tabular Natural Language Inference 2023 SIGMOD 5.2280464e-05
9,487 LLM-PBE: Assessing Data Privacy in Large Language Models 2024 VLDB 5.1708619e-05
10,213 A Universal Question-Answering Platform for Knowledge Graphs 2023 SIGMOD 5.0596605e-05
11,423 Large Language Models for Spatial Analysis Queries 2025 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
536 NaLIR: An Interactive Natural Language Interface for Querying Relational Databases 2014 SIGMOD 0.00016771934
1,250 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011339256
1,846 From Natural Language Processing to Neural Databases 2021 VLDB 9.513089e-05
1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.2807031e-05
1,991 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2383849e-05
2,908 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.8742664e-05
3,282 A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems 2021 SIGMOD 7.4563046e-05
3,521 Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins 2022 VLDB 7.2351481e-05
4,741 Machine Learning for Databases 2021 VLDB 6.4410027e-05
5,120 State of the Art and Open Challenges in Natural Language Interfaces to Data 2020 SIGMOD 6.2651231e-05
5,506 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.1016716e-05
5,967 Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems 2019 VLDB 5.9324372e-05
6,080 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD 5.8924903e-05
7,806 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4500623e-05
8,480 Deep Learning: Systems and Responsibility 2021 SIGMOD 5.333141e-05
9,459 TextCube: Automated Construction and Multidimensional Exploration 2019 VLDB 5.1734318e-05
9,460 Combating Fake News: A Data Management and Mining Perspective 2019 VLDB 5.1734318e-05
11,890 BABOONS: Black-Box Optimization of Data Summaries in Natural Language 2022 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB
2 9,158 Database Perspective on LLM Inference Systems 2025 VLDB
3 1,255 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD
4 9,574 Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Models 2024 VLDB
5 6,384 Natural Language Interfaces for Databases with Deep Learning 2023 VLDB
6 4,630 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB
7 13,691 Harmonizing ML and Databases: A Symphony of Data (VLDB 2024 Keynote) 2024 VLDB
8 5,149 LLM for Data Management 2024 VLDB
9 3,250 How Large Language Models Will Disrupt Data Management 2023 VLDB
10 5,227 Natural Language Data Management and Interfaces: Recent Development and Open Challenges 2017 SIGMOD