DBScholar

Back to papers

The Dawn of Natural Language to SQL: Are We Fully Ready?

Summary: NL2SQL360 provides a multi-angle benchmark and design-space exploration framework for evaluating NL2SQL models across domains and SQL characteristics. It automates method selection, yielding SuperSQL with 87% Spider and 62.66% BIRD execution accuracy. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hd9a8f30ee0d9a9da
Venue
VLDB
Year
2024
Pagerank
9.0012524e-05
Overall Rank
2,117 | 85.82%
DOI
10.14778/3681954.3682003
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{li_vldb24,
        title = {{The Dawn of Natural Language to SQL: Are We Fully Ready?}},
        author = {Li, Boyan and Luo, Yuyu and Chai, Chengliang and Li, Guoliang and Tang, Nan},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {11},
        pages = {3318--3331},
        doi = {10.14778/3681954.3682003},
        url = {https://doi.org/10.14778/3681954.3682003},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 24 of 24 citing papers.

Rank Citing Paper Year Venue Pagerank
3,286 In-depth Analysis of Graph-based RAG in a Unified Framework 2025 VLDB 7.441688e-05
3,914 AOP: Automated and Interactive LLM Pipeline Orchestration for Answering Complex Queries 2025 CIDR 6.9084826e-05
4,004 Cracking SQL Barriers: An LLM-based Dialect Translation System 2025 SIGMOD 6.846192e-05
4,383 R-Bot: An LLM-based Query Rewrite System 2025 VLDB 6.6140223e-05
4,851 Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL 2025 VLDB 6.3681831e-05
5,520 HAIChart: Human and AI Paired Visualization System 2024 VLDB 6.0825599e-05
7,606 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.4698748e-05
9,242 Natural Language to SQL: State of the Art and Open Problems 2025 VLDB 5.1864799e-05
9,338 Sphinteract: Resolving Ambiguities in NL2SQL Through User Interaction 2025 VLDB 5.1782134e-05
9,348 BridgeScope: A Universal Toolkit for Bridging Large Language Models and Databases 2026 CIDR 5.1764094e-05
9,994 Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution 2025 VLDB 5.0845476e-05
10,383 Benchmarking Text-to-SQL under Role-Based Access Control 2027 SIGMOD 4.9605343e-05
10,411 TACO: Token-Aware Context Optimization for Structured OpenStreetMap Query Generation 2027 SIGMOD 4.9605343e-05
10,514 Dialect-Agnostic SQL Parsing via LLM-Based Segmentation 2026 SIGMOD 4.9605343e-05
10,543 HAMMER: An Automatic RAG Tuning System via Hierarchical Memory-Guided Monte Carlo Tree Search 2026 SIGMOD 4.9605343e-05
10,565 OctoSelector: Efficient and Effective Batch-Aware Model Selection for Large Language Models 2026 SIGMOD 4.9605343e-05
10,621 Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks 2026 SIGMOD 4.9605343e-05
10,653 MCTuner: Spatial Decomposition-Enhanced Database Tuning via LLM-Guided Exploration 2026 SIGMOD 4.9605343e-05
10,704 DIVER: A Robust Text-to-SQL System with Dynamic Interactive Value Linking and Evidence Reasoning 2026 SIGMOD 4.9605343e-05
10,766 NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions 2026 VLDB 4.9605343e-05
10,809 OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision 2026 VLDB 4.9605343e-05
11,035 CypherLens: An Interactive Demo for Evaluating and Diagnosing NL-to-Cypher Systems 2026 VLDB 4.9605343e-05
11,104 Data Agents: Rethinking Data Systems in the AI Agent Era 2026 VLDB 4.9605343e-05
11,257 Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization 2025 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
163 Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation 2024 VLDB 0.00027456647
501 CodeS: Towards Building Open-source Language Models for Text-to-SQL 2024 SIGMOD 0.00017239952
523 NaLIR: An Interactive Natural Language Interface for Querying Relational Databases 2014 SIGMOD 0.0001689006
2,216 Few-shot Text-to-SQL Translation using Structure and Content Prompt Learning 2023 SIGMOD 8.8249841e-05
3,246 A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems 2021 SIGMOD 7.4779968e-05
4,345 Synthesizing Natural Language to Visualization (NL2VIS) Benchmarks from NL2SQL Benchmarks 2021 SIGMOD 6.6388774e-05
5,111 An In-Depth Benchmarking of Text-to-SQL Systems 2021 SIGMOD 6.2579636e-05
5,520 HAIChart: Human and AI Paired Visualization System 2024 VLDB 6.0825599e-05
5,773 DeepEye: Creating Good Data Visualizations by Keyword Search 2018 SIGMOD 5.981599e-05
9,345 VerifAI: Verified Generative AI 2024 CIDR 5.1769528e-05
10,208 Sevi: Speech-to-Visualization through Neural Machine Translation 2022 SIGMOD 5.0491152e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 7,972 The Power of Constraints in Natural Language to SQL Translation 2025 VLDB
2 11,526 Welding Natural Language Queries to Analytics IRs with LLMs 2024 CIDR
3 1,209 CatSQL: Towards Real World Natural Language to SQL Applications 2023 VLDB
4 10,837 A Comparative Evaluation of Schema Subsetting for LLM-based NL-to-SQL over Large-Schema Databases 2026 VLDB
5 163 Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation 2024 VLDB
6 3,358 Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL 2024 VLDB
7 10,766 NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions 2026 VLDB
8 2,118 NL2SQL is a solved problem... Not! 2024 CIDR
9 755 Natural language to SQL: Where are we today? 2020 VLDB
10 9,242 Natural Language to SQL: State of the Art and Open Problems 2025 VLDB