LIDER: An Efficient High-dimensional Learned Index for Large-scale Dense Passage Retrieval

Summary: LIDER replaces ANN search with a hierarchical learned index: SK-LSH and key rescaling map high-dimensional embeddings to sortable 1D keys, while RMI predicts locations. It delivers faster, higher-quality retrieval and improved speed–quality trade-offs at scale. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: haeced5510a943f95
Venue: VLDB
Year: 2023
Pagerank: 5.5533524e-05
Overall Rank: 7,322 | 50.78%
DOI: 10.14778/3565816.3565819

Incoming Non-self Citations Over Time

Authors

1. Yifan Wang (University of Florida)
2. Haodi Ma (University of Florida)
3. Daisy Zhe Wang (University of Florida)

BibTeX Citation

@article{wang_vldb23,
        title = {{LIDER: An Efficient High-dimensional Learned Index for Large-scale Dense Passage Retrieval}},
        author = {Wang, Yifan and Ma, Haodi and Wang, Daisy Zhe},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {2},
        pages = {154--166},
        doi = {10.14778/3565816.3565819},
        url = {https://doi.org/10.14778/3565816.3565819},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,613	Starling: An I/O-Efficient Disk-Resident Graph Index Framework for High-Dimensional Vector Similarity Search on Data Segment	2024	SIGMOD	0.00010072237
6,863	Accelerating String-key Learned Index Structures via Memoization-based Incremental Training	2024	VLDB	5.6607844e-05
7,004	Accelerating Graph Indexing for ANNS on Modern CPUs	2025	SIGMOD	5.6238624e-05
10,745	Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
40	The Case for Learned Index Structures	2018	SIGMOD	0.00046284649
280	Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search	2007	VLDB	0.0002230467
555	SageDB: A Learned Database System	2019	CIDR	0.00016506678
868	Learning Multi-dimensional Indexes	2020	SIGMOD	0.00013354403
927	SK-LSH: An Efficient Index Structure for Approximate Nearest Neighbor Search	2014	VLDB	0.00013025904

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,625	Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces	2023	VLDB
2	1,485	PM-LSH: A Fast and Accurate LSH Framework for High-Dimensional Approximate NN Search	2020	VLDB
3	6,740	On the Effects of Dimensionality Reduction on High Dimensional Similarity Search	2001	PODS
4	3,697	Learned Index: A Comprehensive Experimental Evaluation	2023	VLDB
5	848	Benchmarking Learned Indexes	2021	VLDB
6	10,491	PathSeer: Adaptive Neighbor Handling for Efficient Filtered ANN Search	2026	SIGMOD
7	40	The Case for Learned Index Structures	2018	SIGMOD
8	1,634	Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces	2000	VLDB
9	10,443	Efficient Index Layout and Search Strategy for Large-scale High-dimensional Vector Similarity Search	2026	SIGMOD
10	10,078	Accelerating Approximate Nearest Neighbor Search in Hierarchical Graphs: Efficient Level Navigation with Shortcuts	2025	VLDB