Back to papers
Automated Discovery of Test Oracles for Database Management Systems Using LLMs
Summary: Argus uses LLMs to synthesize equivalent-query skeletons, formally checked by a SQL equivalence solver, then instantiates them into reusable DBMS tests. Evaluation across five systems found 41 new bugs, including 36 logic bugs.
(summarized by gpt-5.6-luna on Jul 26 2026)
Paper ID
7390
Venue
SIGMOD
Year
2026
Pagerank
5.093636e-05
Overall Rank
10,199 | 30.03%
DOI
10.1145/3802017
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
BibTeX Citation
Copy BibTeX
@inproceedings{mang_sigmod26,
title = {{Automated Discovery of Test Oracles for Database Management Systems Using LLMs}},
author = {Mang, Qiuyang and He, Runyuan and Zhong, Suyang and Liu, Xiaoxuan and Zhang, Huanchen and Cheung, Alvin},
series = {{SIGMOD} '26},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3802017},
url = {https://dl.acm.org/doi/10.1145/3802017},
year = {2026}
}
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
Rank
Citing Paper
Year
Venue
Pagerank
Outgoing Citations (Sorted by Pagerank)
Showing 29 of 29 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Rank
Cited Paper
Year
Venue
Pagerank
103
DuckDB: an Embeddable Analytical Database
2019
SIGMOD
0.00034161428
271
TiDB: A Raft-based HTAP Database
2020
VLDB
0.00022703024
392
Massive Stochastic Testing of SQL
1998
VLDB
0.00019342814
445
Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources
2018
SIGMOD
0.00018336751
734
QAGen: Generating Query-Aware Test Databases
2007
SIGMOD
0.00014525584
910
Cosette: An Automated Prover for SQL
2017
CIDR
0.00013285905
1,343
DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing
2025
VLDB
0.00011095866
1,982
WeTune: Automatic Discovery and Verification of Query Rewrite Rules
2022
SIGMOD
9.3573897e-05
2,030
APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
2020
VLDB
9.2841464e-05
2,044
Detecting Logic Bugs of Join Optimizations in DBMS
2023
SIGMOD
9.2663577e-05
2,369
Data Generation using Declarative Constraints
2011
SIGMOD
8.682429e-05
2,553
LLM-R^2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency
2025
VLDB
8.4283807e-05
3,769
Proving Query Equivalence Using Linear Integer Arithmetic
2023
SIGMOD
7.1403543e-05
3,903
Keep It Simple: Testing Databases via Differential Query Plans
2024
SIGMOD
7.0304586e-05
4,129
Testing Graph Database Systems via Graph-Aware Metamorphic Relations
2024
VLDB
6.8840169e-05
5,105
SAM: Database Generation from Query Workloads with Supervised Autoregressive Models
2022
SIGMOD
6.3628539e-05
5,353
QED: A Powerful Query Equivalence Decider for SQL
2024
VLDB
6.2519268e-05
5,429
Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction
2024
VLDB
6.222006e-05
5,744
SQLStorm: Taking Database Benchmarking into the LLM Era
2025
VLDB
6.1019672e-05
6,267
Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency
2025
SIGMOD
5.9348282e-05
7,427
Constant Optimization Driven Database System Testing
2025
SIGMOD
5.620674e-05
7,809
Can Large Language Models Be Query Optimizer for Relational Databases?
2026
SIGMOD
5.5399022e-05
8,829
Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees
2026
SIGMOD
5.3613784e-05
9,227
Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction
2025
VLDB
5.3023217e-05
9,561
Leveraging Application Data Constraints to Optimize Database-Backed Web Applications
2023
VLDB
5.2528121e-05
9,866
Finding Logic Bugs in Graph-processing Systems via Graph-cutting
2025
SIGMOD
5.2043672e-05
9,871
Finding Logic Bugs in Spatial Database Engines via Affine Equivalent Inputs
2024
SIGMOD
5.2043672e-05
9,941
An Adaptive Benchmark for Modeling User Exploration of Large Datasets
2025
SIGMOD
5.1915905e-05
9,945
ParSEval: Plan-aware Test Database Generation for SQL Equivalence Evaluation
2025
VLDB
5.1915905e-05
Semantically Similar Papers
#
Overall Rank
Paper
Year
Venue
1
10,535
Why Database Manuals Are Not Enough: Efficient and Reliable Configuration Tuning for DBMSs via Code-Driven LLM Agents
2026
VLDB
2
10,705
Andromeda: Debugging Database Performance Issues with Retrieval-Augmented Large Language Models
2025
SIGMOD
3
2,044
Detecting Logic Bugs of Join Optimizations in DBMS
2023
SIGMOD
4
9,351
DBG-PT: A Large Language Model Assisted Query Performance Regression Debugger
2024
VLDB
5
9,227
Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction
2025
VLDB
6
10,331
Testing Graph Databases with Synthesized Queries
2026
SIGMOD
7
10,139
Leveraging Query Optimizers to Verify the Soundness of LLM-based Query Rewrites for Real-World Workloads, and More!
2026
CIDR
8
3,757
Panda: Performance Debugging for Databases using LLM Agents
2024
CIDR
9
10,216
DBugScribe: Automatic Database Bug Reproduction from Community Reports
2026
SIGMOD
10
5,856
Automatic Database Configuration Debugging using Retrieval-Augmented Language Models
2025
SIGMOD