Natural language to SQL: Where are we today?
Summary: A unified evaluation of 11 NL2SQL methods across 10+ benchmarks, including WTQ and TPC-H, exposes hidden dataset/method assumptions and inadequacies of standard metrics. It provides a taxonomy, systematic error analysis, and database-backed validation via query rewriting and testing. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Hyeonji Kim (Pohang University of Science and Technology)
- 2. Byeong-Hoon So (Pohang University of Science and Technology)
- 3. Wook-Shin Han (Pohang University of Science and Technology)
- 4. Hongrae Lee (Google)
BibTeX Citation
@article{kim_vldb20,
title = {{Natural language to SQL: Where are we today?}},
author = {Kim, Hyeonji and So, Byeong-Hoon and Han, Wook-Shin and Lee, Hongrae},
journal = {PVLDB},
series = {{VLDB} '20},
volume = {13},
number = {10},
pages = {1737--1750},
doi = {10.14778/3401960.3401970},
url = {https://doi.org/10.14778/3401960.3401970},
year = {2020}
}Incoming Citations (Sorted by Pagerank)
Showing 28 of 28 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 178 | Constructing an Interactive Natural Language Interface for Relational Databases | 2015 | VLDB | 0.00026568976 |
| 430 | ATHENA: An Ontology-Driven System for Natural Language Querying over Relational Data Stores | 2016 | VLDB | 0.00018415668 |
| 787 | Cosette: An Automated Prover for SQL | 2017 | CIDR | 0.00013959502 |
| 1,678 | Axiomatic Foundations and Algorithms for Deciding Semantic Equivalences of SQL Queries | 2018 | VLDB | 9.8966017e-05 |
| 2,747 | DBPal: A Learned NL-Interface for Databases | 2018 | SIGMOD | 8.0453676e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 5,111 | An In-Depth Benchmarking of Text-to-SQL Systems | 2021 | SIGMOD |
| 2 | 3,322 | MT-Teql: Evaluating and Augmenting Neural NLIDB on Real-world Linguistic and Schema Variations | 2022 | VLDB |
| 3 | 3,246 | A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems | 2021 | SIGMOD |
| 4 | 6,328 | Natural Language Interfaces for Databases with Deep Learning | 2023 | VLDB |
| 5 | 1,209 | CatSQL: Towards Real World Natural Language to SQL Applications | 2023 | VLDB |
| 6 | 10,766 | NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions | 2026 | VLDB |
| 7 | 1,999 | DBPal: A Fully Pluggable NL2SQL Training Pipeline | 2020 | SIGMOD |
| 8 | 2,117 | The Dawn of Natural Language to SQL: Are We Fully Ready? | 2024 | VLDB |
| 9 | 2,118 | NL2SQL is a solved problem... Not! | 2024 | CIDR |
| 10 | 9,242 | Natural Language to SQL: State of the Art and Open Problems | 2025 | VLDB |