DBScholar

Back to papers

Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation

Summary: Systematic benchmark of prompt-engineering components (question representation, example selection/organization) and token-efficiency for LLM-based Text-to-SQL. Proposes DAIL-SQL (86.6% execution on Spider) and evaluates open-source LLMs with supervised fine-tuning, revealing accuracy/efficiency/cost trade-offs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h37b8ad61902e832d
Venue
VLDB
Year
2024
Pagerank
0.00027456647
Overall Rank
163 | 98.91%
DOI
10.14778/3641204.3641221
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{gao_vldb24,
        title = {{Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation}},
        author = {Gao, Dawei and Wang, Haibin and Qian, Yichen and Li, Yaliang and Ding, Bolin and Sun, Xiuyu and Zhou, Jingren},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {5},
        pages = {1132--1145},
        doi = {10.14778/3641204.3641221},
        url = {https://doi.org/10.14778/3641204.3641221},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 67 citing papers.

Rank Citing Paper Year Venue Pagerank
10,785 SQL-Exchange: Transforming SQL Queries Across Domains 2026 VLDB 4.9605343e-05
10,809 OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision 2026 VLDB 4.9605343e-05
10,818 LakeHelm: Zero-Shot Lakehouse Advisor for Joint Engine-Format Selection and Configuration 2026 VLDB 4.9605343e-05
10,851 SafeQL: Search-based Refinement for Safe and Efficient LLM-based Text-to-SQL 2026 VLDB 4.9605343e-05
10,914 I-Rex: An Interactive Debugger for SQL 2026 VLDB 4.9605343e-05
10,962 Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System 2026 VLDB 4.9605343e-05
10,963 Developing and Benchmarking Verification Algorithms to Improve Text-to-SQL Generation 2026 VLDB 4.9605343e-05
11,010 Bridging NL2SQL for CAN Signal Analytics at NIO: From Externalized Schemas to CTE Pipelines 2026 VLDB 4.9605343e-05
11,028 SpatialSQL: A Multi-Agent System for Interactive and Observable Spatial Text-to-SQL 2026 VLDB 4.9605343e-05
11,039 Text-to-SQL Evaluation Toolkit 2026 VLDB 4.9605343e-05
11,066 Persona-Conditioned Query Generation for Selectivity-Controlled Workloads 2026 VLDB 4.9605343e-05
11,090 ATLAS: Adaptive Text-to-SQL with Lifecycle-Aware Self-Maintaining Context 2026 VLDB 4.9605343e-05
11,141 Pervasive Annotation Errors Break Text-to-SQL Benchmarks and Leaderboards 2026 VLDB 4.9605343e-05
11,214 DataDazzle: Intelligent Data Exploration through Natural Language 2025 SIGMOD 4.9605343e-05
11,260 PLM4NDV: Minimizing Data Access for Number of Distinct Values Estimation with Pre-trained Language Models 2025 SIGMOD 4.9605343e-05
11,365 LLMLog: Advanced Log Template Generation via LLM-driven Multi-Round Annotation 2025 VLDB 4.9605343e-05
11,438 Towards Automated Cross-domain Exploratory Data Analysis through Large Language Models 2025 VLDB 4.9605343e-05
Previous Page 2 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1,750 Duoquest: A Dual-Specification System for Expressive SQL Queries 2020 SIGMOD 9.7140093e-05
1,931 CodexDB: Synthesizing Code for Query Processing from Natural Language Instructions using GPT-3 Codex 2022 VLDB 9.3449634e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,851 SafeQL: Search-based Refinement for Safe and Efficient LLM-based Text-to-SQL 2026 VLDB
2 1,789 OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale 2025 VLDB
3 10,383 Benchmarking Text-to-SQL under Role-Based Access Control 2027 SIGMOD
4 3,358 Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL 2024 VLDB
5 501 CodeS: Towards Building Open-source Language Models for Text-to-SQL 2024 SIGMOD
6 10,837 A Comparative Evaluation of Schema Subsetting for LLM-based NL-to-SQL over Large-Schema Databases 2026 VLDB
7 5,111 An In-Depth Benchmarking of Text-to-SQL Systems 2021 SIGMOD
8 2,117 The Dawn of Natural Language to SQL: Are We Fully Ready? 2024 VLDB
9 10,766 NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions 2026 VLDB
10 10,809 OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision 2026 VLDB