MT-Teql: Evaluating and Augmenting Neural NLIDB on Real-world Linguistic and Schema Variations
Summary: MT-Teql applies metamorphic, semantics-preserving transformations to utterances and schemas, benchmarking NLIDB robustness without reannotation. Testing nine models found 15,433 defects; using triggering variants for augmentation removed 46.5% of errors. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Pingchuan Ma (Hong Kong University of Science and Technology)
- 2. Shuai Wang (Hong Kong University of Science and Technology)
BibTeX Citation
@article{ma_vldb22,
title = {{MT-Teql: Evaluating and Augmenting Neural NLIDB on Real-world Linguistic and Schema Variations}},
author = {Ma, Pingchuan and Wang, Shuai},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {3},
pages = {569--582},
doi = {10.14778/3494124.3494139},
url = {https://doi.org/10.14778/3494124.3494139},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 7 of 7 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,209 | CatSQL: Towards Real World Natural Language to SQL Applications | 2023 | VLDB | 0.00011499224 |
| 1,852 | ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems | 2024 | VLDB | 9.4935131e-05 |
| 3,940 | Testing Graph Database Systems via Graph-Aware Metamorphic Relations | 2024 | VLDB | 6.8942302e-05 |
| 4,689 | SNAILS: Schema Naming Assessments for Improved LLM-Based SQL Inference | 2025 | SIGMOD | 6.4513088e-05 |
| 9,242 | Natural Language to SQL: State of the Art and Open Problems | 2025 | VLDB | 5.1864799e-05 |
| 9,994 | Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution | 2025 | VLDB | 5.0845476e-05 |
| 11,486 | Panel on Neural Relational Data: Tabular Foundation Models, LLMs... or both? | 2025 | VLDB | 4.9605343e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 178 | Constructing an Interactive Natural Language Interface for Relational Databases | 2015 | VLDB | 0.00026568976 |
| 430 | ATHENA: An Ontology-Driven System for Natural Language Querying over Relational Data Stores | 2016 | VLDB | 0.00018415668 |
| 727 | Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms | 2015 | VLDB | 0.00014426954 |
| 755 | Natural language to SQL: Where are we today? | 2020 | VLDB | 0.00014210408 |
| 1,999 | DBPal: A Fully Pluggable NL2SQL Training Pipeline | 2020 | SIGMOD | 9.2108564e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 9,242 | Natural Language to SQL: State of the Art and Open Problems | 2025 | VLDB |
| 2 | 2,591 | Text2SQL is Not Enough: Unifying AI and Databases with TAG | 2025 | CIDR |
| 3 | 12,101 | Toward Pure Natural Language Interaction with Databases | 2020 | CIDR |
| 4 | 2,117 | The Dawn of Natural Language to SQL: Are We Fully Ready? | 2024 | VLDB |
| 5 | 9,994 | Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution | 2025 | VLDB |
| 6 | 6,528 | Reliable Text-to-SQL with Adaptive Abstention | 2025 | SIGMOD |
| 7 | 1,815 | From Natural Language Processing to Neural Databases | 2021 | VLDB |
| 8 | 1,209 | CatSQL: Towards Real World Natural Language to SQL Applications | 2023 | VLDB |
| 9 | 10,766 | NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions | 2026 | VLDB |
| 10 | 755 | Natural language to SQL: Where are we today? | 2020 | VLDB |