Benchmarking Text-to-SQL under Role-Based Access Control

Summary: Introduces an LLM-assisted, human-audited framework for augmenting text-to-SQL benchmarks with realistic RBAC roles and policies, plus metrics that separate query utility from access compliance. Evaluation reveals that strong unrestricted benchmark scores—especially for open-weight LLMs—can mask frequent policy violations and steep degradation under access controls. (summarized by gpt-6-luna on Oct 22 2026)

Paper ID: h06c8eb2f5c295550
Venue: SIGMOD
Year: 2027
Pagerank: 4.9605343e-05
Overall Rank: 10,383 | 30.41%
DOI: 10.1145/3837098
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Yang Fei (National University of Singapore)
2. Yangfan Jiang (National University of Singapore)
3. Yin Yang (Hamad Bin Khalifa University)
4. Xiaokui Xiao (National University of Singapore)

BibTeX Citation

@inproceedings{fei_sigmod27,
        title = {{Benchmarking Text-to-SQL under Role-Based Access Control}},
        author = {Fei, Yang and Jiang, Yangfan and Yang, Yin and Xiao, Xiaokui},
        series = {{SIGMOD} '27},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3837098},
        url = {https://dl.acm.org/doi/10.1145/3837098},
        year = {2027}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
163	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB	0.00027456647
501	CodeS: Towards Building Open-source Language Models for Text-to-SQL	2024	SIGMOD	0.00017239952
523	NaLIR: An Interactive Natural Language Interface for Querying Relational Databases	2014	SIGMOD	0.0001689006
605	CAESURA: Language Models as Multi-Modal Query Planners	2024	CIDR	0.00015630219
755	Natural language to SQL: Where are we today?	2020	VLDB	0.00014210408
1,209	CatSQL: Towards Real World Natural Language to SQL Applications	2023	VLDB	0.00011499224
1,669	Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks	2024	SIGMOD	9.9157758e-05
1,977	OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignment	2025	SIGMOD	9.2659291e-05
2,117	The Dawn of Natural Language to SQL: Are We Fully Ready?	2024	VLDB	9.0012524e-05
2,216	Few-shot Text-to-SQL Translation using Structure and Content Prompt Learning	2023	SIGMOD	8.8249841e-05
3,358	Combining Small Language Models and Large Language Models for Zero-Shot NL2SQL	2024	VLDB	7.3650961e-05
3,899	FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis	2024	SIGMOD	6.9199448e-05
4,689	SNAILS: Schema Naming Assessments for Improved LLM-Based SQL Inference	2025	SIGMOD	6.4513088e-05
4,851	Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL	2025	VLDB	6.3681831e-05
4,917	Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency	2025	SIGMOD	6.3447485e-05
6,528	Reliable Text-to-SQL with Adaptive Abstention	2025	SIGMOD	5.7375274e-05
9,348	BridgeScope: A Universal Toolkit for Bridging Large Language Models and Databases	2026	CIDR	5.1764094e-05
9,994	Evoschema: Towards Text-To-Sql Robustness Against Schema Evolution	2025	VLDB	5.0845476e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,972	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB
2	10,621	Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks	2026	SIGMOD
3	10,809	OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision	2026	VLDB
4	11,228	RTS+: Reliable Text to SQL	2025	SIGMOD
5	10,963	Developing and Benchmarking Verification Algorithms to Improve Text-to-SQL Generation	2026	VLDB
6	9,250	BenchPress: A Human-in-the-Loop Annotation System for Rapid Text-to-SQL Benchmark Curation	2026	CIDR
7	10,766	NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions	2026	VLDB
8	5,111	An In-Depth Benchmarking of Text-to-SQL Systems	2021	SIGMOD
9	163	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation	2024	VLDB
10	6,528	Reliable Text-to-SQL with Adaptive Abstention	2025	SIGMOD