Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction

Summary: Introduce Radar: construct a “raw” DB by stripping metadata while preserving data and compare query results between original and raw to expose metadata-related logic bugs from incorrect metadata-driven optimizations. Adds metadata-oriented testing to prioritize unseen metadata patterns; evaluated on five DBMSs, found 42 bugs (38 new, 16 fixed). (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13613
Venue: VLDB
Year: 2024
Pagerank: 6.222006e-05
Overall Rank: 5,429 | 62.76%
DOI: 10.14778/3659437.3659445

Incoming Non-self Citations Over Time

Authors

1. Jiansen Song (Institute of Software, Chinese Academy of Sciences)
2. Wensheng Dou (Institute of Software, Chinese Academy of Sciences)
3. Yu Gao (Institute of Software, Chinese Academy of Sciences)
4. Ziyu Cui (Institute of Software, Chinese Academy of Sciences)
5. Yingying Zheng (Institute of Software, Chinese Academy of Sciences)
6. Dong Wang (Institute of Software, Chinese Academy of Sciences)
7. Wei Wang (Institute of Software, Chinese Academy of Sciences)
8. Jun Wei (Institute of Software, Chinese Academy of Sciences)
9. Tao Huang (Institute of Software, Chinese Academy of Sciences)

BibTeX Citation

@article{song_vldb24,
        title = {{Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction}},
        author = {Song, Jiansen and Dou, Wensheng and Gao, Yu and Cui, Ziyu and Zheng, Yingying and Wang, Dong and Wang, Wei and Wei, Jun and Huang, Tao},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {8},
        pages = {1884--1897},
        doi = {10.14778/3659437.3659445},
        url = {https://doi.org/10.14778/3659437.3659445},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,227	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB	5.3023217e-05
9,869	Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems	2025	VLDB	5.2043672e-05
10,199	Automated Discovery of Test Oracles for Database Management Systems Using LLMs	2026	SIGMOD	5.093636e-05
10,216	DBugScribe: Automatic Database Bug Reproduction from Community Reports	2026	SIGMOD	5.093636e-05
10,331	Testing Graph Databases with Synthesized Queries	2026	SIGMOD	5.093636e-05
10,358	Detecting Logic Bugs in DBMSs via Equivalent Data Construction	2026	SIGMOD	5.093636e-05
10,477	One DBMS, Two Modes, and a Bunch of Bugs: Catching Logic Bugs in Distributed DBMSs via Differential Testing	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
105	Quickly Generating Billion-Record Synthetic Databases	1994	SIGMOD	0.00033877899
271	TiDB: A Raft-based HTAP Database	2020	VLDB	0.00022703024
392	Massive Stochastic Testing of SQL	1998	VLDB	0.00019342814
734	QAGen: Generating Query-Aware Test Databases	2007	SIGMOD	0.00014525584
938	Flexible Database Generators	2005	VLDB	0.00013089351
1,080	Elle: Inferring Isolation Anomalies from Experimental Observations	2021	VLDB	0.00012257972
1,578	Simple and Realistic Data Generation	2006	VLDB	0.00010309264
2,030	APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems	2020	VLDB	9.2841464e-05
2,044	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD	9.2663577e-05
3,392	Complete Yet Practical Search for Minimal Query Reformulations Under Constraints	2014	SIGMOD	7.4515019e-05
3,903	Keep It Simple: Testing Databases via Differential Query Plans	2024	SIGMOD	7.0304586e-05
4,199	Exploiting Constraint-Like Data Characterizations in Query Optimization	2001	SIGMOD	6.8388774e-05
5,373	Analysis of Recovery in a Database System Using a Write-Ahead Log Protocol	1992	SIGMOD	6.2425455e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,129	Testing Graph Database Systems via Graph-Aware Metamorphic Relations	2024	VLDB
2	10,235	EPSC: Testing Database Management Systems via Equivalent Prepared Statement Construction	2026	SIGMOD
3	10,477	One DBMS, Two Modes, and a Bunch of Bugs: Catching Logic Bugs in Distributed DBMSs via Differential Testing	2026	SIGMOD
4	10,331	Testing Graph Databases with Synthesized Queries	2026	SIGMOD
5	2,044	Detecting Logic Bugs of Join Optimizations in DBMS	2023	SIGMOD
6	7,756	Semantic Conformance Testing of Relational DBMS	2025	VLDB
7	7,427	Constant Optimization Driven Database System Testing	2025	SIGMOD
8	8,482	A Demonstration of DLBD: Database Logic Bug Detection System	2023	VLDB
9	10,358	Detecting Logic Bugs in DBMSs via Equivalent Data Construction	2026	SIGMOD
10	9,227	Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction	2025	VLDB