The Dawn of Natural Language to SQL: Are We Fully Ready?

Summary: NL2SQL360 provides a multi-angle benchmark and design-space exploration framework for evaluating NL2SQL models across domains and SQL characteristics. It automates method selection, yielding SuperSQL with 87% Spider and 62.66% BIRD execution accuracy. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hd9a8f30ee0d9a9da
Venue: VLDB
Year: 2024
Pagerank: 8.6009821e-05
Overall Rank: 2,348 | 84.22%
DOI: 10.14778/3681954.3682003

Incoming Non-self Citations Over Time

Authors

1. Boyan Li (Hong Kong University of Science and Technology)
2. Yuyu Luo (Hong Kong University of Science and Technology)
3. Chengliang Chai (Beijing Institute of Technology)
4. Guoliang Li (Tsinghua University)
5. Nan Tang (Hong Kong University of Science and Technology)

BibTeX Citation

@article{li_vldb24,
        title = {{The Dawn of Natural Language to SQL: Are We Fully Ready?}},
        author = {Li, Boyan and Luo, Yuyu and Chai, Chengliang and Li, Guoliang and Tang, Nan},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {11},
        pages = {3318--3331},
        doi = {10.14778/3681954.3682003},
        url = {https://doi.org/10.14778/3681954.3682003},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,466	In-depth Analysis of Graph-based RAG in a Unified Framework	2025	VLDB	7.2783993e-05
4,142	AOP: Automated and Interactive LLM Pipeline Orchestration for Answering Complex Queries	2025	CIDR	6.7814795e-05
4,229	Cracking SQL Barriers: An LLM-based Dialect Translation System	2025	SIGMOD	6.7165534e-05
4,385	R-Bot: An LLM-based Query Rewrite System	2025	VLDB	6.6235293e-05
5,116	Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL	2025	VLDB	6.2678524e-05
5,495	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.1056297e-05
7,583	Data Imputation with Limited Data Redundancy Using Data Lakes	2025	VLDB	5.4906208e-05
9,210	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB	5.2061511e-05
9,304	Sphinteract: Resolving Ambiguities in NL2SQL Through User Interaction	2025	VLDB	5.1978532e-05
10,145	BridgeScope: A Universal Toolkit for Bridging Large Language Models and Databases	2026	CIDR	5.0715586e-05
10,436	Dialect-Agnostic SQL Parsing via LLM-Based Segmentation	2026	SIGMOD	4.9793485e-05
10,466	HAMMER: An Automatic RAG Tuning System via Hierarchical Memory-Guided Monte Carlo Tree Search	2026	SIGMOD	4.9793485e-05
10,488	OctoSelector: Efficient and Effective Batch-Aware Model Selection for Large Language Models	2026	SIGMOD	4.9793485e-05
10,545	Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks	2026	SIGMOD	4.9793485e-05
10,580	MCTuner: Spatial Decomposition-Enhanced Database Tuning via LLM-Guided Exploration	2026	SIGMOD	4.9793485e-05
10,632	DIVER: A Robust Text-to-SQL System with Dynamic Interactive Value Linking and Evidence Reasoning	2026	SIGMOD	4.9793485e-05
10,695	NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions	2026	VLDB	4.9793485e-05
10,738	OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision	2026	VLDB	4.9793485e-05
10,965	CypherLens: An Interactive Demo for Evaluating and Diagnosing NL-to-Cypher Systems	2026	VLDB	4.9793485e-05
11,034	Data Agents: Rethinking Data Systems in the AI Agent Era	2026	VLDB	4.9793485e-05
11,189	Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization	2025	SIGMOD	4.9793485e-05
11,328	Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution	2025	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
174	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB	0.00026790979
533	CodeS: Towards Building Open-source Language Models for Text-to-SQL	2024	SIGMOD	0.00016826571
536	NaLIR: An Interactive Natural Language Interface for Querying Relational Databases	2014	SIGMOD	0.00016771934
2,467	Few-shot Text-to-SQL Translation using Structure and Content Prompt Learning	2023	SIGMOD	8.4211526e-05
3,282	A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems	2021	SIGMOD	7.4563046e-05
4,864	Synthesizing Natural Language to Visualization (NL2VIS) Benchmarks from NL2SQL Benchmarks	2021	SIGMOD	6.3770469e-05
5,155	An In-Depth Benchmarking of Text-to-SQL Systems	2021	SIGMOD	6.250495e-05
5,495	HAIChart: Human and AI Paired Visualization System	2024	VLDB	6.1056297e-05
5,759	DeepEye: Creating Good Data Visualizations by Keyword Search	2018	SIGMOD	6.0042797e-05
9,311	VerifAI: Verified Generative AI	2024	CIDR	5.1965878e-05
10,170	Sevi: Speech-to-Visualization through Neural Machine Translation	2022	SIGMOD	5.0682654e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,952	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB
2	11,468	Welding Natural Language Queries to Analytics IRs with LLMs	2024	CIDR
3	1,356	CatSQL: Towards Real World Natural Language to SQL Applications	2023	VLDB
4	10,766	A Comparative Evaluation of Schema Subsetting for LLM-based NL-to-SQL over Large-Schema Databases	2026	VLDB
5	174	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB
6	3,489	Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL	2024	VLDB
7	2,117	NL2SQL is a solved problem... Not!	2024	CIDR
8	10,695	NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions	2026	VLDB
9	776	Natural language to SQL: Where are we today?	2020	VLDB
10	9,210	Natural Language to SQL: State of the Art and Open Problems	2025	VLDB