DBScholar

Back to papers

Automated Discovery of Test Oracles for Database Management Systems Using LLMs

Summary: Argus uses LLMs to synthesize equivalent-query skeletons, formally checked by a SQL equivalence solver, then instantiates them into reusable DBMS tests. Evaluation across five systems found 41 new bugs, including 36 logic bugs. (summarized by gpt-5.6-luna on Jul 26 2026)

Paper ID
7390
Venue
SIGMOD
Year
2026
Pagerank
5.093636e-05
Overall Rank
10,199 | 30.03%
DOI
10.1145/3802017

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@inproceedings{mang_sigmod26,
        title = {{Automated Discovery of Test Oracles for Database Management Systems Using LLMs}},
        author = {Mang, Qiuyang and He, Runyuan and Zhong, Suyang and Liu, Xiaoxuan and Zhang, Huanchen and Cheung, Alvin},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3802017},
        url = {https://dl.acm.org/doi/10.1145/3802017},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 29 of 29 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
103 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00034161428
271 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00022703024
392 Massive Stochastic Testing of SQL 1998 VLDB 0.00019342814
445 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00018336751
734 QAGen: Generating Query-Aware Test Databases 2007 SIGMOD 0.00014525584
910 Cosette: An Automated Prover for SQL 2017 CIDR 0.00013285905
1,343 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00011095866
1,982 WeTune: Automatic Discovery and Verification of Query Rewrite Rules 2022 SIGMOD 9.3573897e-05
2,030 APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems 2020 VLDB 9.2841464e-05
2,044 Detecting Logic Bugs of Join Optimizations in DBMS 2023 SIGMOD 9.2663577e-05
2,369 Data Generation using Declarative Constraints 2011 SIGMOD 8.682429e-05
2,553 LLM-R^2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency 2025 VLDB 8.4283807e-05
3,769 Proving Query Equivalence Using Linear Integer Arithmetic 2023 SIGMOD 7.1403543e-05
3,903 Keep It Simple: Testing Databases via Differential Query Plans 2024 SIGMOD 7.0304586e-05
4,129 Testing Graph Database Systems via Graph-Aware Metamorphic Relations 2024 VLDB 6.8840169e-05
5,105 SAM: Database Generation from Query Workloads with Supervised Autoregressive Models 2022 SIGMOD 6.3628539e-05
5,353 QED: A Powerful Query Equivalence Decider for SQL 2024 VLDB 6.2519268e-05
5,429 Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction 2024 VLDB 6.222006e-05
5,744 SQLStorm: Taking Database Benchmarking into the LLM Era 2025 VLDB 6.1019672e-05
6,267 Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency 2025 SIGMOD 5.9348282e-05
7,427 Constant Optimization Driven Database System Testing 2025 SIGMOD 5.620674e-05
7,809 Can Large Language Models Be Query Optimizer for Relational Databases? 2026 SIGMOD 5.5399022e-05
8,829 Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees 2026 SIGMOD 5.3613784e-05
9,227 Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction 2025 VLDB 5.3023217e-05
9,561 Leveraging Application Data Constraints to Optimize Database-Backed Web Applications 2023 VLDB 5.2528121e-05
9,866 Finding Logic Bugs in Graph-processing Systems via Graph-cutting 2025 SIGMOD 5.2043672e-05
9,871 Finding Logic Bugs in Spatial Database Engines via Affine Equivalent Inputs 2024 SIGMOD 5.2043672e-05
9,941 An Adaptive Benchmark for Modeling User Exploration of Large Datasets 2025 SIGMOD 5.1915905e-05
9,945 ParSEval: Plan-aware Test Database Generation for SQL Equivalence Evaluation 2025 VLDB 5.1915905e-05
Previous Page 1 / 1 Next

Semantically Similar Papers