Keep It Simple: Testing Databases via Differential Query Plans

Summary: Proposes Differential Query Plan (DQP) testing: force multiple physical plans for the same query and check result consistency, instead of TQS-style table splitting/oracle synthesis. Surprisingly simple yet strong: reproduces 14/15 TQS bugs, finds 26 new ones, and is complementary to NoREC/TLP. (summarized by gpt-5.4-mini on May 24 2026)

Paper ID: 7013
Venue: SIGMOD
Year: 2024
Pagerank: 7.0304586e-05
Overall Rank: 3,903 | 73.23%
DOI: 10.1145/3654991

Incoming Non-self Citations Over Time

Authors

1. Jinsheng Ba (National University of Singapore)
2. Manuel Rigger (National University of Singapore)

BibTeX Citation

@inproceedings{ba_sigmod24,
        title = {{Keep It Simple: Testing Databases via Differential Query Plans}},
        author = {Ba, Jinsheng and Rigger, Manuel},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3654991},
        url = {https://dl.acm.org/doi/10.1145/3654991},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,429	Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction	2024	VLDB	6.222006e-05
9,227	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB	5.3023217e-05
9,777	PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking	2025	VLDB	5.2209769e-05
9,866	Finding Logic Bugs in Graph-processing Systems via Graph-cutting	2025	SIGMOD	5.2043672e-05
9,869	Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems	2025	VLDB	5.2043672e-05
10,199	Automated Discovery of Test Oracles for Database Management Systems Using LLMs	2026	SIGMOD	5.093636e-05
10,216	DBugScribe: Automatic Database Bug Reproduction from Community Reports	2026	SIGMOD	5.093636e-05
10,218	Detecting Join Bugs in Database Engines via Join Implication Reasoning	2026	SIGMOD	5.093636e-05
10,235	EPSC: Testing Database Management Systems via Equivalent Prepared Statement Construction	2026	SIGMOD	5.093636e-05
10,331	Testing Graph Databases with Synthesized Queries	2026	SIGMOD	5.093636e-05
10,402	SRS: Detecting Logic Bugs of Join Implementation in DBMSs via Set Relation Synthesis	2026	SIGMOD	5.093636e-05
10,477	One DBMS, Two Modes, and a Bunch of Bugs: Catching Logic Bugs in Distributed DBMSs via Differential Testing	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0024089429
105	Quickly Generating Billion-Record Synthetic Databases	1994	SIGMOD	0.00033877899
208	CockroachDB: The Resilient Geo-Distributed SQL Database	2020	SIGMOD	0.00024968157
734	QAGen: Generating Query-Aware Test Databases	2007	SIGMOD	0.00014525584
1,362	Execution Strategies for SQL Subqueries	2007	SIGMOD	0.00011032204
2,030	APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems	2020	VLDB	9.2841464e-05
2,044	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD	9.2663577e-05
2,069	Generating Targeted Queries for Database Testing	2008	SIGMOD	9.2293717e-05
2,275	Counter Strike: Generic Top-Down Join Enumeration for Hypergraphs	2013	VLDB	8.8196821e-05
2,690	Generating Thousand Benchmark Queries in Seconds	2004	VLDB	8.2519326e-05
3,813	Query Simplification: Graceful Degradation for Join-Order Optimization	2009	SIGMOD	7.1051056e-05
4,111	A genetic approach for random testing of database systems	2007	VLDB	6.8945321e-05
7,441	PgCuckoo: Laying Plan Eggs in PostgreSQL's Nest	2019	SIGMOD	5.6173637e-05
8,482	A Demonstration of DLBD: Database Logic Bug Detection System	2023	VLDB	5.4161786e-05
9,240	Automatic SQL Error Mitigation in Oracle	2023	VLDB	5.3004142e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,227	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB
2	3,970	Counting, Enumerating, and Sampling of Execution Plans in a Cost-Based Query Optimizer	2000	SIGMOD
3	7,427	Constant Optimization Driven Database System Testing	2025	SIGMOD
4	5,113	Test Data for Relational Queries (Extended abstract)	1986	PODS
5	12,496	A Framework for Testing Query Transformation Rules	2009	SIGMOD
6	10,402	SRS: Detecting Logic Bugs of Join Implementation in DBMSs via Set Relation Synthesis	2026	SIGMOD
7	10,406	Test Data Generation for Complex SQL Queries	2026	SIGMOD
8	2,069	Generating Targeted Queries for Database Testing	2008	SIGMOD
9	10,331	Testing Graph Databases with Synthesized Queries	2026	SIGMOD
10	2,044	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD