Keep It Simple: Testing Databases via Differential Query Plans

Summary: Proposes Differential Query Plan (DQP) testing: force multiple physical plans for the same query and check result consistency, instead of TQS-style table splitting/oracle synthesis. Surprisingly simple yet strong: reproduces 14/15 TQS bugs, finds 26 new ones, and is complementary to NoREC/TLP. (summarized by gpt-5.4-mini on May 24 2026)

Paper ID: h97c60b233d00f0af
Venue: SIGMOD
Year: 2024
Pagerank: 7.1293371e-05
Overall Rank: 3,652 | 75.46%
DOI: 10.1145/3654991
PDF: Download (CC BY-NC 4.0)

Incoming Non-self Citations Over Time

Authors

1. Jinsheng Ba (National University of Singapore)
2. Manuel Rigger (National University of Singapore)

BibTeX Citation

@inproceedings{ba_sigmod24,
        title = {{Keep It Simple: Testing Databases via Differential Query Plans}},
        author = {Ba, Jinsheng and Rigger, Manuel},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3654991},
        url = {https://dl.acm.org/doi/10.1145/3654991},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,058	Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction	2024	VLDB	6.2915045e-05
8,643	PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking	2025	VLDB	5.2956539e-05
9,228	EPSC: Testing Database Management Systems via Equivalent Prepared Statement Construction	2026	SIGMOD	5.2032182e-05
9,231	SRS: Detecting Logic Bugs of Join Implementation in DBMSs via Set Relation Synthesis	2026	SIGMOD	5.2032182e-05
9,412	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB	5.1808981e-05
10,061	Finding Logic Bugs in Graph-processing Systems via Graph-cutting	2025	SIGMOD	5.0851868e-05
10,065	Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems	2025	VLDB	5.0851868e-05
10,427	Automated Discovery of Test Oracles for Database Management Systems Using LLMs	2026	SIGMOD	4.9769913e-05
10,444	DBugScribe: Automatic Database Bug Reproduction from Community Reports	2026	SIGMOD	4.9769913e-05
10,446	Detecting Join Bugs in Database Engines via Join Implication Reasoning	2026	SIGMOD	4.9769913e-05
10,547	Testing Graph Databases with Synthesized Queries	2026	SIGMOD	4.9769913e-05
10,675	One DBMS, Two Modes, and a Bunch of Bugs: Catching Logic Bugs in Distributed DBMSs via Differential Testing	2026	SIGMOD	4.9769913e-05
10,881	Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023943337
106	Quickly Generating Billion-Record Synthetic Databases	1994	SIGMOD	0.00033518428
185	CockroachDB: The Resilient Geo-Distributed SQL Database	2020	SIGMOD	0.00026060465
748	QAGen: Generating Query-Aware Test Databases	2007	SIGMOD	0.00014277246
1,378	Execution Strategies for SQL Subqueries	2007	SIGMOD	0.00010859556
1,832	APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems	2020	VLDB	9.5385854e-05
1,893	Generating Targeted Queries for Database Testing	2008	SIGMOD	9.4149369e-05
1,930	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD	9.3522789e-05
2,252	Counter Strike: Generic Top-Down Join Enumeration for Hypergraphs	2013	VLDB	8.7480805e-05
2,712	Generating Thousand Benchmark Queries in Seconds	2004	VLDB	8.0997193e-05
3,800	Query Simplification: Graceful Degradation for Join-Order Optimization	2009	SIGMOD	7.0130412e-05
4,115	A genetic approach for random testing of database systems	2007	VLDB	6.7953368e-05
7,477	PgCuckoo: Laying Plan Eggs in PostgreSQL's Nest	2019	SIGMOD	5.5147831e-05
8,624	A Demonstration of DLBD: Database Logic Bug Detection System	2023	VLDB	5.2997911e-05
9,359	Automatic SQL Error Mitigation in Oracle	2023	VLDB	5.1866777e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,412	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB
2	4,040	Counting, Enumerating, and Sampling of Execution Plans in a Cost-Based Query Optimizer	2000	SIGMOD
3	6,102	Constant Optimization Driven Database System Testing	2025	SIGMOD
4	5,240	Test Data for Relational Queries (Extended abstract)	1986	PODS
5	12,792	A Framework for Testing Query Transformation Rules	2009	SIGMOD
6	9,231	SRS: Detecting Logic Bugs of Join Implementation in DBMSs via Set Relation Synthesis	2026	SIGMOD
7	7,644	Test Data Generation for Complex SQL Queries	2026	SIGMOD
8	1,893	Generating Targeted Queries for Database Testing	2008	SIGMOD
9	10,547	Testing Graph Databases with Synthesized Queries	2026	SIGMOD
10	1,930	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD