DBScholar

Back to papers

From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management

Summary: Survey of very large language models (VLLMs) for data management, detailing usage in DB tasks with minimal fine-tuning. Explores Codex-style code generation, libraries/APIs, and LM-based architectures and integration with traditional systems. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
13073
Venue
VLDB
Year
2022
Pagerank
6.697553e-05
Overall Rank
4,449 | 69.48%
DOI
10.14778/3554821.3554896

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{trummer_vldb22,
        title = {{From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management}},
        author = {Trummer, Immanuel},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {12},
        pages = {3770--3773},
        doi = {10.14778/3554821.3554896},
        url = {https://doi.org/10.14778/3554821.3554896},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank Citing Paper Year Venue Pagerank
5,354 Can Large Language Models Predict Data Correlations from Column Names? 2023 VLDB 6.2515841e-05
6,192 Pre-trained Embeddings for Entity Resolution: An Experimental Analysis 2023 VLDB 5.947284e-05
6,378 Demonstrating GPT-DB: Generating Query-Specific and Customizable Code for SQL Processing with GPT-4 2023 VLDB 5.8929835e-05
6,997 E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model 2025 VLDB 5.7300324e-05
7,075 Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity 2024 VLDB 5.7099047e-05
8,945 Generation of Training Examples for Tabular Natural Language Inference 2023 SIGMOD 5.3480421e-05
9,310 LLM-PBE: Assessing Data Privacy in Large Language Models 2024 VLDB 5.289545e-05
9,351 DBG-PT: A Large Language Model Assisted Query Performance Regression Debugger 2024 VLDB 5.2839552e-05
10,023 A Universal Question-Answering Platform for Knowledge Graphs 2023 SIGMOD 5.1757914e-05
11,061 Large Language Models for Spatial Analysis Queries 2025 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
555 NaLIR: An Interactive Natural Language Interface for Querying Relational Databases 2014 SIGMOD 0.00016568053
1,337 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011117488
2,019 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2983994e-05
2,175 From Natural Language Processing to Neural Databases 2021 VLDB 9.0215773e-05
2,521 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 8.4729505e-05
2,888 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.9941489e-05
3,339 A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems 2021 SIGMOD 7.5047676e-05
3,589 Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins 2022 VLDB 7.2812353e-05
5,078 State of the Art and Open Challenges in Natural Language Interfaces to Data 2020 SIGMOD 6.3728705e-05
5,340 Machine Learning for Databases 2021 VLDB 6.2603359e-05
5,865 Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems 2019 VLDB 6.0619534e-05
5,925 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.0397888e-05
5,978 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD 6.0212877e-05
7,661 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.5736026e-05
8,328 Deep Learning: Systems and Responsibility 2021 SIGMOD 5.4535681e-05
9,294 TextCube: Automated Construction and Multidimensional Exploration 2019 VLDB 5.2906228e-05
9,295 Combating Fake News: A Data Management and Mining Perspective 2019 VLDB 5.2906228e-05
11,582 BABOONS: Black-Box Optimization of Data Summaries in Natural Language 2022 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 2,521 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB
2 13,343 Database Perspective on LLM Inference Systems 2025 VLDB
3 1,250 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD
4 9,391 Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Models 2024 VLDB
5 6,870 Natural Language Interfaces for Databases with Deep Learning 2023 VLDB
6 4,836 Transformers for Tabular Data Representation: A Tutorial on Models and Applications 2022 VLDB
7 13,377 Harmonizing ML and Databases: A Symphony of Data (VLDB 2024 Keynote) 2024 VLDB
8 6,101 LLM for Data Management 2024 VLDB
9 3,536 How Large Language Models Will Disrupt Data Management 2023 VLDB
10 5,130 Natural Language Data Management and Interfaces: Recent Development and Open Challenges 2017 SIGMOD