The Dawn of Natural Language to SQL: Are We Fully Ready?

Summary: NL2SQL360 provides a multi-angle benchmark and design-space exploration framework for evaluating NL2SQL models across domains and SQL characteristics. It automates method selection, yielding SuperSQL with 87% Spider and 62.66% BIRD execution accuracy. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 13732
Venue: VLDB
Year: 2024
Pagerank: 8.0455088e-05
Overall Rank: 2,852 | 80.44%
DOI: 10.14778/3681954.3682003

Incoming Non-self Citations Over Time

Authors

1. Boyan Li (Hong Kong University of Science and Technology)
2. Yuyu Luo (Hong Kong University of Science and Technology)
3. Chengliang Chai (Beijing Institute of Technology)
4. Guoliang Li (Tsinghua University)
5. Nan Tang (Hong Kong University of Science and Technology)

BibTeX Citation

@article{li_vldb24,
        title = {{The Dawn of Natural Language to SQL: Are We Fully Ready?}},
        author = {Li, Boyan and Luo, Yuyu and Chai, Chengliang and Li, Guoliang and Tang, Nan},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {11},
        pages = {3318--3331},
        doi = {10.14778/3681954.3682003},
        url = {https://doi.org/10.14778/3681954.3682003},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 20 of 20 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,366	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.2457679e-05
6,254	In-depth Analysis of Graph-based RAG in a Unified Framework	2025	VLDB	5.9405174e-05
6,259	R-Bot: An LLM-based Query Rewrite System	2025	VLDB	5.93967e-05
7,332	Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL	2025	VLDB	5.6433374e-05
7,439	AOP: Automated and Interactive LLM Pipeline Orchestration for Answering Complex Queries	2025	CIDR	5.6181103e-05
8,423	Cracking SQL Barriers: An LLM-based Dialect Translation System	2025	SIGMOD	5.4275169e-05
9,136	Sphinteract: Resolving Ambiguities in NL2SQL Through User Interaction	2025	VLDB	5.3166292e-05
9,550	Data Imputation with Limited Data Redundancy Using Data Lakes	2025	VLDB	5.2528121e-05
9,870	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB	5.2043672e-05
10,140	BridgeScope: A Universal Toolkit for Bridging Large Language Models and Databases	2026	CIDR	5.093636e-05
10,220	Dialect-Agnostic SQL Parsing via LLM-Based Segmentation	2026	SIGMOD	5.093636e-05
10,253	HAMMER: An Automatic RAG Tuning System via Hierarchical Memory-Guided Monte Carlo Tree Search	2026	SIGMOD	5.093636e-05
10,276	OctoSelector: Efficient and Effective Batch-Aware Model Selection for Large Language Models	2026	SIGMOD	5.093636e-05
10,344	Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks	2026	SIGMOD	5.093636e-05
10,384	MCTuner: Spatial Decomposition-Enhanced Database Tuning via LLM-Guided Exploration	2026	SIGMOD	5.093636e-05
10,444	DIVER: A Robust Text-to-SQL System with Dynamic Interactive Value Linking and Evidence Reasoning	2026	SIGMOD	5.093636e-05
10,510	NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions	2026	VLDB	5.093636e-05
10,556	OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision	2026	VLDB	5.093636e-05
10,769	Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization	2025	SIGMOD	5.093636e-05
10,940	Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
279	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB	0.00022468369
555	NaLIR: An Interactive Natural Language Interface for Querying Relational Databases	2014	SIGMOD	0.00016568053
756	CodeS: Towards Building Open-source Language Models for Text-to-SQL	2024	SIGMOD	0.0001431656
2,748	Few-shot Text-to-SQL Translation using Structure and Content Prompt Learning	2023	SIGMOD	8.1707811e-05
3,339	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD	7.5047676e-05
4,809	Synthesizing Natural Language to Visualization (NL2VIS) Benchmarks from NL2SQL Benchmarks	2021	SIGMOD	6.4984309e-05
5,174	An In-Depth Benchmarking of Text-to-SQL Systems	2021	SIGMOD	6.3337874e-05
5,366	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.2457679e-05
5,634	DeepEye: Creating Good Data Visualizations by Keyword Search	2018	SIGMOD	6.1412942e-05
9,177	VerifAI: Verified Generative AI	2024	CIDR	5.3078984e-05
9,976	Sevi: Speech-to-Visualization through Neural Machine Translation	2022	SIGMOD	5.1845938e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,039	ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems	2024	VLDB
2	9,305	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB
3	11,120	Welding Natural Language Queries to Analytics IRs with LLMs	2024	CIDR
4	1,444	CatSQL: Towards Real World Natural Language to SQL Applications	2023	VLDB
5	279	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB
6	3,787	Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL	2024	VLDB
7	10,510	NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions	2026	VLDB
8	2,602	NL2SQL is a solved problem... Not!	2024	CIDR
9	865	Natural language to SQL: Where are we today?	2020	VLDB
10	9,870	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB