DBScholar

Back to papers

Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation

Summary: Systematic benchmark of prompt-engineering components (question representation, example selection/organization) and token-efficiency for LLM-based Text-to-SQL. Proposes DAIL-SQL (86.6% execution on Spider) and evaluates open-source LLMs with supervised fine-tuning, revealing accuracy/efficiency/cost trade-offs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h37b8ad61902e832d
Venue
VLDB
Year
2024
Pagerank
0.00026790979
Overall Rank
174 | 98.84%
DOI
10.14778/3641204.3641221

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{gao_vldb24,
        title = {{Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation}},
        author = {Gao, Dawei and Wang, Haibin and Qian, Yichen and Li, Yaliang and Ding, Bolin and Sun, Xiuyu and Zhou, Jingren},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {5},
        pages = {1132--1145},
        doi = {10.14778/3641204.3641221},
        url = {https://doi.org/10.14778/3641204.3641221},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 64 citing papers.

Rank Citing Paper Year Venue Pagerank
533 CodeS: Towards Building Open-source Language Models for Text-to-SQL 2024 SIGMOD 0.00016826571
1,777 OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale 2025 VLDB 9.664552e-05
2,025 OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignment 2025 SIGMOD 9.163622e-05
2,348 The Dawn of Natural Language to SQL: Are We Fully Ready? 2024 VLDB 8.6009821e-05
3,336 GenRewrite: Query Rewriting via Large Language Models 2026 SIGMOD 7.4137763e-05
3,489 Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL 2024 VLDB 7.2627807e-05
4,331 FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis 2024 SIGMOD 6.6590534e-05
4,731 QUEST: Query Optimization in Unstructured Document Analysis 2025 VLDB 6.4462032e-05
4,787 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.4143303e-05
4,924 SNAILS: Schema Naming Assessments for Improved LLM-Based SQL Inference 2025 SIGMOD 6.3512934e-05
5,116 Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL 2025 VLDB 6.2678524e-05
5,544 Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency 2025 SIGMOD 6.0887243e-05
6,220 GenEdit: Compounding Operators and Continuous Improvement to Tackle Text-to-SQL in the Enterprise 2025 CIDR 5.8469622e-05
7,012 Reliable Text-to-SQL with Adaptive Abstention 2025 SIGMOD 5.6218378e-05
7,952 The Power of Constraints in Natural Language to SQL Translation 2025 VLDB 5.4198293e-05
8,016 Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models 2024 VLDB 5.4065977e-05
8,291 ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines 2026 VLDB 5.3612871e-05
8,316 ThriftLLM: On Cost-Effective Selection of Large Language Models for Classification Queries 2025 VLDB 5.3561732e-05
8,361 LEAP: LLM-powered End-to-end Automatic Library for Processing Social Science Queries on Unstructured Data 2025 VLDB 5.3474284e-05
8,887 mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs 2025 VLDB 5.2559789e-05
8,888 Optimized Batch Prompting for Cost-effective LLMs 2025 VLDB 5.2559789e-05
9,069 Unveiling Challenges for LLMs in Enterprise Data Engineering 2026 VLDB 5.2283159e-05
9,210 Natural Language to SQL: State of the Art and Open Problems 2025 VLDB 5.2061511e-05
9,217 Text-to-SQL Benchmarks are Broken: An In-Depth Analysis of Annotation Errors 2026 CIDR 5.2056825e-05
9,222 SQL-Factory: A Multi-Agent Framework for High-Quality and Large-Scale SQL Generation 2026 VLDB 5.2056825e-05
9,304 Sphinteract: Resolving Ambiguities in NL2SQL Through User Interaction 2025 VLDB 5.1978532e-05
9,645 Self-Enhancing Video Data Management System for Compositional Events with Large Language Models 2025 SIGMOD 5.1453267e-05
9,904 AgentTune: An Agent-Based Large Language Model Framework for Database Knob Tuning 2026 SIGMOD 5.1103839e-05
10,129 ParSEval: Plan-aware Test Database Generation for SQL Equivalence Evaluation 2025 VLDB 5.0751052e-05
10,337 QueryArtisan: Generating Data Manipulation Codes for Ad-hoc Analysis in Data Lakes 2025 VLDB 5.0200193e-05
10,432 DBugScribe: Automatic Database Bug Reproduction from Community Reports 2026 SIGMOD 4.9793485e-05
10,433 DeepEye-SQL: A Software-Engineering-Inspired Text-to-SQL Framework 2026 SIGMOD 4.9793485e-05
10,436 Dialect-Agnostic SQL Parsing via LLM-Based Segmentation 2026 SIGMOD 4.9793485e-05
10,462 Generalized Entity Matching with Adaptivity via Large Language Models 2026 SIGMOD 4.9793485e-05
10,488 OctoSelector: Efficient and Effective Batch-Aware Model Selection for Large Language Models 2026 SIGMOD 4.9793485e-05
10,497 Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewards 2026 SIGMOD 4.9793485e-05
10,545 Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks 2026 SIGMOD 4.9793485e-05
10,560 Drama: Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries 2026 SIGMOD 4.9793485e-05
10,585 PLForge: Enhancing Language Models for Natural Language to Procedural Extensions of SQL 2026 SIGMOD 4.9793485e-05
10,594 Reliable Answers for Recurring Questions: Boosting Text-to-SQL Accuracy with Template Constrained Decoding 2026 SIGMOD 4.9793485e-05
10,596 SEFRQO: A Self-Evolving Fine-Tuned RAG-Based Query Optimizer 2026 SIGMOD 4.9793485e-05
10,632 DIVER: A Robust Text-to-SQL System with Dynamic Interactive Value Linking and Evidence Reasoning 2026 SIGMOD 4.9793485e-05
10,670 PRISM: Navigating Cost–Accuracy Trade-offs for NL2SQL 2026 SIGMOD 4.9793485e-05
10,695 NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions 2026 VLDB 4.9793485e-05
10,714 SQL-Exchange: Transforming SQL Queries Across Domains 2026 VLDB 4.9793485e-05
10,738 OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision 2026 VLDB 4.9793485e-05
10,747 LakeHelm: Zero-Shot Lakehouse Advisor for Joint Engine-Format Selection and Configuration 2026 VLDB 4.9793485e-05
10,780 SafeQL: Search-based Refinement for Safe and Efficient LLM-based Text-to-SQL 2026 VLDB 4.9793485e-05
10,843 I-Rex: An Interactive Debugger for SQL 2026 VLDB 4.9793485e-05
10,892 Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System 2026 VLDB 4.9793485e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1,781 Duoquest: A Dual-Specification System for Expressive SQL Queries 2020 SIGMOD 9.6534325e-05
1,975 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.2807031e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,433 DeepEye-SQL: A Software-Engineering-Inspired Text-to-SQL Framework 2026 SIGMOD
2 10,780 SafeQL: Search-based Refinement for Safe and Efficient LLM-based Text-to-SQL 2026 VLDB
3 1,777 OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale 2025 VLDB
4 3,489 Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL 2024 VLDB
5 533 CodeS: Towards Building Open-source Language Models for Text-to-SQL 2024 SIGMOD
6 10,766 A Comparative Evaluation of Schema Subsetting for LLM-based NL-to-SQL over Large-Schema Databases 2026 VLDB
7 5,155 An In-Depth Benchmarking of Text-to-SQL Systems 2021 SIGMOD
8 2,348 The Dawn of Natural Language to SQL: Are We Fully Ready? 2024 VLDB
9 10,695 NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions 2026 VLDB
10 10,738 OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision 2026 VLDB