DBScholar

Back to papers

Automated Discovery of Test Oracles for Database Management Systems Using LLMs

Summary: Argus uses LLMs to synthesize equivalent-query skeletons, formally checked by a SQL equivalence solver, then instantiates them into reusable DBMS tests. Evaluation across five systems found 41 new bugs, including 36 logic bugs. (summarized by gpt-5.6-luna on Jul 26 2026)

Paper ID
h7ced0dcd20d3e2c8
Venue
SIGMOD
Year
2026
Pagerank
4.9605343e-05
Overall Rank
10,493 | 29.67%
DOI
10.1145/3802017
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@inproceedings{mang_sigmod26,
        title = {{Automated Discovery of Test Oracles for Database Management Systems Using LLMs}},
        author = {Mang, Qiuyang and He, Runyuan and Zhong, Suyang and Liu, Xiaoxuan and Zhang, Huanchen and Cheung, Alvin},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3802017},
        url = {https://dl.acm.org/doi/10.1145/3802017},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank Citing Paper Year Venue Pagerank
10,382 Automated Database Testing via LLM-Synthesized SQL Features 2027 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 29 of 29 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037688945
232 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00023776373
378 Massive Stochastic Testing of SQL 1998 VLDB 0.000196128
382 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.0001946654
630 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00015402076
751 QAGen: Generating Query-Aware Test Databases 2007 SIGMOD 0.00014245413
787 Cosette: An Automated Prover for SQL 2017 CIDR 0.00013959502
1,765 APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems 2020 VLDB 9.689153e-05
1,854 Detecting Logic Bugs of Join Optimizations in DBMS 2023 SIGMOD 9.4858897e-05
1,888 WeTune: Automatic Discovery and Verification of Query Rewrite Rules 2022 SIGMOD 9.4148912e-05
1,956 LLM-R^2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency 2025 VLDB 9.2927535e-05
2,422 Data Generation using Declarative Constraints 2011 SIGMOD 8.4785012e-05
2,971 Proving Query Equivalence Using Linear Integer Arithmetic 2023 SIGMOD 7.7851336e-05
3,652 Keep It Simple: Testing Databases via Differential Query Plans 2024 SIGMOD 7.1150097e-05
3,909 SQLStorm: Taking Database Benchmarking into the LLM Era 2025 VLDB 6.9127576e-05
3,940 Testing Graph Database Systems via Graph-Aware Metamorphic Relations 2024 VLDB 6.8942302e-05
4,116 QED: A Powerful Query Equivalence Decider for SQL 2024 VLDB 6.7846764e-05
4,748 Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction 2024 VLDB 6.4257176e-05
4,917 Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency 2025 SIGMOD 6.3447485e-05
5,237 SAM: Database Generation from Query Workloads with Supervised Autoregressive Models 2022 SIGMOD 6.2027113e-05
5,883 Leveraging Application Data Constraints to Optimize Database-Backed Web Applications 2023 VLDB 5.9423067e-05
6,118 Constant Optimization Driven Database System Testing 2025 SIGMOD 5.8646302e-05
6,584 Can Large Language Models Be Query Optimizer for Relational Databases? 2026 SIGMOD 5.72395e-05
8,426 Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction 2025 VLDB 5.3187835e-05
8,543 Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees 2026 SIGMOD 5.3039559e-05
10,093 Finding Logic Bugs in Graph-processing Systems via Graph-cutting 2025 SIGMOD 5.068372e-05
10,100 Finding Logic Bugs in Spatial Database Engines via Affine Equivalent Inputs 2024 SIGMOD 5.068372e-05
10,167 An Adaptive Benchmark for Modeling User Exploration of Large Datasets 2025 SIGMOD 5.0559291e-05
10,170 ParSEval: Plan-aware Test Database Generation for SQL Equivalence Evaluation 2025 VLDB 5.0559291e-05
Previous Page 1 / 1 Next

Semantically Similar Papers