DBScholar

Back to papers

Automated Discovery of Test Oracles for Database Management Systems Using LLMs

Summary: Argus uses LLMs to synthesize equivalent-query skeletons, formally checked by a SQL equivalence solver, then instantiates them into reusable DBMS tests. Evaluation across five systems found 41 new bugs, including 36 logic bugs. (summarized by gpt-5.6-luna on Jul 26 2026)

Paper ID
h7ced0dcd20d3e2c8
Venue
SIGMOD
Year
2026
Pagerank
4.9793485e-05
Overall Rank
10,415 | 29.98%
DOI
10.1145/3802017

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@inproceedings{mang_sigmod26,
        title = {{Automated Discovery of Test Oracles for Database Management Systems Using LLMs}},
        author = {Mang, Qiuyang and He, Runyuan and Zhong, Suyang and Liu, Xiaoxuan and Zhang, Huanchen and Cheung, Alvin},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3802017},
        url = {https://dl.acm.org/doi/10.1145/3802017},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 29 of 29 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037720227
234 TiDB: A Raft-based HTAP Database 2020 VLDB 0.00023765806
379 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00019514689
383 Massive Stochastic Testing of SQL 1998 VLDB 0.00019484034
683 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00014817539
747 QAGen: Generating Query-Aware Test Databases 2007 SIGMOD 0.00014283935
790 Cosette: An Automated Prover for SQL 2017 CIDR 0.00013976438
1,832 APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems 2020 VLDB 9.5430971e-05
1,893 WeTune: Automatic Discovery and Verification of Query Rewrite Rules 2022 SIGMOD 9.4126198e-05
1,928 Detecting Logic Bugs of Join Optimizations in DBMS 2023 SIGMOD 9.3567082e-05
2,039 LLM-R^2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency 2025 VLDB 9.1493268e-05
2,413 Data Generation using Declarative Constraints 2011 SIGMOD 8.5094338e-05
2,961 Proving Query Equivalence Using Linear Integer Arithmetic 2023 SIGMOD 7.8068219e-05
3,651 Keep It Simple: Testing Databases via Differential Query Plans 2024 SIGMOD 7.1327136e-05
3,936 Testing Graph Database Systems via Graph-Aware Metamorphic Relations 2024 VLDB 6.9162836e-05
4,102 QED: A Powerful Query Equivalence Decider for SQL 2024 VLDB 6.8070264e-05
4,132 SQLStorm: Taking Database Benchmarking into the LLM Era 2025 VLDB 6.7885553e-05
5,054 Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction 2024 VLDB 6.2944842e-05
5,209 SAM: Database Generation from Query Workloads with Supervised Autoregressive Models 2022 SIGMOD 6.2262056e-05
5,544 Automated Validating and Fixing of Text-to-SQL Translation with Execution Consistency 2025 SIGMOD 6.0887243e-05
5,869 Leveraging Application Data Constraints to Optimize Database-Backed Web Applications 2023 VLDB 5.9648445e-05
6,100 Constant Optimization Driven Database System Testing 2025 SIGMOD 5.8868734e-05
6,586 Can Large Language Models Be Query Optimizer for Relational Databases? 2026 SIGMOD 5.7430662e-05
8,997 Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees 2026 SIGMOD 5.2410834e-05
9,403 Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction 2025 VLDB 5.1833519e-05
10,056 Finding Logic Bugs in Graph-processing Systems via Graph-cutting 2025 SIGMOD 5.0875952e-05
10,061 Finding Logic Bugs in Spatial Database Engines via Affine Equivalent Inputs 2024 SIGMOD 5.0875952e-05
10,126 An Adaptive Benchmark for Modeling User Exploration of Large Datasets 2025 SIGMOD 5.0751052e-05
10,129 ParSEval: Plan-aware Test Database Generation for SQL Equivalence Evaluation 2025 VLDB 5.0751052e-05
Previous Page 1 / 1 Next

Semantically Similar Papers