Natural language to SQL: Where are we today?
Summary: A unified evaluation of 11 NL2SQL methods across 10+ benchmarks, including WTQ and TPC-H, exposes hidden dataset/method assumptions and inadequacies of standard metrics. It provides a taxonomy, systematic error analysis, and database-backed validation via query rewriting and testing. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Hyeonji Kim (Pohang University of Science and Technology)
- 2. Byeong-Hoon So (Pohang University of Science and Technology)
- 3. Wook-Shin Han (Pohang University of Science and Technology)
- 4. Hongrae Lee (Google)
BibTeX Citation
@article{kim_vldb20,
title = {{Natural language to SQL: Where are we today?}},
author = {Kim, Hyeonji and So, Byeong-Hoon and Han, Wook-Shin and Lee, Hongrae},
journal = {PVLDB},
series = {{VLDB} '20},
volume = {13},
number = {10},
pages = {1737--1750},
doi = {10.14778/3401960.3401970},
url = {https://doi.org/10.14778/3401960.3401970},
year = {2020}
}Incoming Citations (Sorted by Pagerank)
Showing 27 of 27 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 180 | Constructing an Interactive Natural Language Interface for Relational Databases | 2015 | VLDB | 0.00026541021 |
| 439 | ATHENA: An Ontology-Driven System for Natural Language Querying over Relational Data Stores | 2016 | VLDB | 0.00018253425 |
| 790 | Cosette: An Automated Prover for SQL | 2017 | CIDR | 0.00013971102 |
| 1,680 | Axiomatic Foundations and Algorithms for Deciding Semantic Equivalences of SQL Queries | 2018 | VLDB | 9.9000396e-05 |
| 2,777 | DBPal: A Learned NL-Interface for Databases | 2018 | SIGMOD | 8.0271197e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 5,156 | An In-Depth Benchmarking of Text-to-SQL Systems | 2021 | SIGMOD |
| 2 | 3,353 | MT-Teql: Evaluating and Augmenting Neural NLIDB on Real-world Linguistic and Schema Variations | 2022 | VLDB |
| 3 | 3,284 | A Deep Dive into Deep Learning Approaches for Text-to-SQL Systems | 2021 | SIGMOD |
| 4 | 6,387 | Natural Language Interfaces for Databases with Deep Learning | 2023 | VLDB |
| 5 | 1,356 | CatSQL: Towards Real World Natural Language to SQL Applications | 2023 | VLDB |
| 6 | 10,705 | NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions | 2026 | VLDB |
| 7 | 2,014 | DBPal: A Fully Pluggable NL2SQL Training Pipeline | 2020 | SIGMOD |
| 8 | 2,349 | The Dawn of Natural Language to SQL: Are We Fully Ready? | 2024 | VLDB |
| 9 | 2,117 | NL2SQL is a solved problem... Not! | 2024 | CIDR |
| 10 | 9,220 | Natural Language to SQL: State of the Art and Open Problems | 2025 | VLDB |