Revisiting Filtered ANN Benchmarks: A Hardness-Controlled Benchmark Generator for Realistic Evaluation

Summary: Introduces α-Hardness, an execution-driven FANN query metric based on overfetching that predicts performance more reliably than selectivity or attribute correlation. HCBGen controls hardness to generate realistic, privacy-preserving workloads and expose gaps hidden by easy benchmarks. (summarized by gpt-5.6-luna on Aug 28 2026)

Paper ID: h7bfe7ef3804c09d2
Venue: VLDB
Year: 2026
Pagerank: 4.9793485e-05
Overall Rank: 10,823 | 27.24%
DOI: 10.14778/3828612.3828630

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Mintaek Lim (Seoul National University)
2. Dogeun Kim (Seoul National University)
3. Minwoo Kim (Seoul National University)
4. Jaeyoung Do (Seoul National University)

BibTeX Citation

@article{lim_vldb26,
        title = {{Revisiting Filtered ANN Benchmarks: A Hardness-Controlled Benchmark Generator for Realistic Evaluation}},
        author = {Lim, Mintaek and Kim, Dogeun and Kim, Minwoo and Do, Jaeyoung},
        journal = {PVLDB},
        series = {{VLDB} '26},
        volume = {19},
        number = {10},
        pages = {2763--2776},
        doi = {10.14778/3828612.3828630},
        url = {https://doi.org/10.14778/3828612.3828630},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023947656
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064031282
15	How Good Are Query Optimizers, Really?	2016	VLDB	0.00061066921
194	Milvus: A Purpose-Built Vector Data Management System	2021	SIGMOD	0.00025636725
341	AnalyticDB-V: A Hybrid Analytical Engine Towards Query Fusion for Structured and Unstructured Data	2020	VLDB	0.00020539791
1,225	ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data	2024	SIGMOD	0.00011444398
1,603	SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning	2019	SIGMOD	0.00010097649
1,839	Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet	2024	VLDB	9.5304799e-05
2,783	Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor Search	2024	SIGMOD	8.0242863e-05
2,872	The Lernaean Hydra of Data Series Similarity Search: An Experimental Evaluation of the State of the Art	2019	VLDB	7.9228762e-05
4,598	Steiner-Hardness: A Query Hardness Measure for Graph-Based ANN Indexes	2024	VLDB	6.5086378e-05
7,305	RWalks: Random Walks as Attribute Diffusers for Filtered Vector Search	2025	SIGMOD	5.5586007e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,547	Beyond Vector Search: Querying With and Without Predicates	2026	SIGMOD
2	12,754	Efficient RkNN Retrieval with Arbitrary Non-Metric Similarity Measures	2010	VLDB
3	10,516	VecBench: A Controllable Benchmark for Filtered Vector Search: [Experiments & Analysis]	2026	SIGMOD
4	10,753	An Experimental Evaluation of Hybrid Querying on Vectors	2026	VLDB
5	6,868	Flexible Aggregate Similarity Search	2011	SIGMOD
6	10,323	Dynamically Detect and Fix Hardness for Efficient Approximate Nearest Neighbor Search	2026	SIGMOD
7	10,326	Fast-Convergent Proximity Graphs for Approximate Nearest Neighbor Search	2026	SIGMOD
8	4,598	Steiner-Hardness: A Query Hardness Measure for Graph-Based ANN Indexes	2024	VLDB
9	10,769	Harmonizing Efficiency and Accuracy in Filtered Vector Search	2026	VLDB
10	8,259	Attribute Filtering in Approximate Nearest Neighbor Search: An In-depth Experimental Study	2026	SIGMOD