LIDER: An Efficient High-dimensional Learned Index for Large-scale Dense Passage Retrieval
Summary: LIDER replaces ANN search with a hierarchical learned index: SK-LSH and key rescaling map high-dimensional embeddings to sortable 1D keys, while RMI predicts locations. It delivers faster, higher-quality retrieval and improved speed–quality trade-offs at scale. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Yifan Wang (University of Florida)
- 2. Haodi Ma (University of Florida)
- 3. Daisy Zhe Wang (University of Florida)
BibTeX Citation
@article{wang_vldb23,
title = {{LIDER: An Efficient High-dimensional Learned Index for Large-scale Dense Passage Retrieval}},
author = {Wang, Yifan and Ma, Haodi and Wang, Daisy Zhe},
journal = {PVLDB},
series = {{VLDB} '23},
volume = {16},
number = {2},
pages = {154--166},
doi = {10.14778/3565816.3565819},
url = {https://doi.org/10.14778/3565816.3565819},
year = {2023}
}Incoming Citations (Sorted by Pagerank)
Showing 4 of 4 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,760 | Starling: An I/O-Efficient Disk-Resident Graph Index Framework for High-Dimensional Vector Similarity Search on Data Segment | 2024 | SIGMOD | 9.8157819e-05 |
| 7,166 | Accelerating Graph Indexing for ANNS on Modern CPUs | 2025 | SIGMOD | 5.6846045e-05 |
| 7,368 | Accelerating String-key Learned Index Structures via Memoization-based Incremental Training | 2024 | VLDB | 5.6315363e-05 |
| 10,563 | Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search | 2026 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 43 | The Case for Learned Index Structures | 2018 | SIGMOD | 0.00046060254 |
| 287 | Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search | 2007 | VLDB | 0.00022323585 |
| 568 | SageDB: A Learned Database System | 2019 | CIDR | 0.0001641553 |
| 873 | Learning Multi-dimensional Indexes | 2020 | SIGMOD | 0.00013481915 |
| 990 | SK-LSH: An Efficient Index Structure for Approximate Nearest Neighbor Search | 2014 | VLDB | 0.00012796562 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,934 | Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces | 2023 | VLDB |
| 2 | 1,546 | PM-LSH: A Fast and Accurate LSH Framework for High-Dimensional Approximate NN Search | 2020 | VLDB |
| 3 | 6,646 | On the Effects of Dimensionality Reduction on High Dimensional Similarity Search | 2001 | PODS |
| 4 | 3,792 | Learned Index: A Comprehensive Experimental Evaluation | 2023 | VLDB |
| 5 | 847 | Benchmarking Learned Indexes | 2021 | VLDB |
| 6 | 43 | The Case for Learned Index Structures | 2018 | SIGMOD |
| 7 | 10,279 | PathSeer: Adaptive Neighbor Handling for Efficient Filtered ANN Search | 2026 | SIGMOD |
| 8 | 1,602 | Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces | 2000 | VLDB |
| 9 | 10,227 | Efficient Index Layout and Search Strategy for Large-scale High-dimensional Vector Similarity Search | 2026 | SIGMOD |
| 10 | 9,892 | Accelerating Approximate Nearest Neighbor Search in Hierarchical Graphs: Efficient Level Navigation with Shortcuts | 2025 | VLDB |