Back to papers
RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
Summary: RetroInfer rethinks KV-cache management for long-context LLM inference as a vector storage problem, offloading cache to CPU and retrieving only attention-relevant tokens. Its wave index and wave buffer jointly target sparse-attention accuracy/cost tradeoffs and GPU-CPU data movement, yielding full-attention accuracy with much higher throughput.
(summarized by gpt-5.4-mini on Apr 12 2026)
- Paper ID
- 14257
- Venue
- VLDB
- Year
- 2026
- Pagerank
- 4.1905499e-05
- Overall Rank
- 10,222 | 28.96%
- DOI
-
10.14778/3796195.3796212
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
Outgoing Citations (Sorted by Pagerank)
Showing 20 of 20 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 210 |
Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graph |
2019 |
VLDB |
0.00034086264 |
| 494 |
Milvus: A Purpose-Built Vector Data Management System |
2021 |
SIGMOD |
0.00021769407 |
| 1,617 |
PASE: PostgreSQL Ultra-High-Dimensional Approximate Nearest Neighbor Search Extension |
2020 |
SIGMOD |
0.0001113145 |
| 2,264 |
Manu: A Cloud Native Vector Database Management System |
2022 |
VLDB |
9.1587362e-05 |
| 2,321 |
High-Throughput Vector Similarity Search in Knowledge Graphs |
2023 |
SIGMOD |
9.0359336e-05 |
| 2,525 |
ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data |
2024 |
SIGMOD |
8.5991468e-05 |
| 2,687 |
HVS: Hierarchical Graph Structure Based on Voronoi Diagrams for Solving Approximate Nearest Neighbor Search |
2022 |
VLDB |
8.3079951e-05 |
| 2,969 |
Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces |
2023 |
VLDB |
7.7955562e-05 |
| 3,182 |
DeltaPQ: Lossless Product Quantization Code Compression for High Dimensional Similarity Search |
2020 |
VLDB |
7.4280768e-05 |
| 3,612 |
SingleStore-V: An Integrated Vector Database System in SingleStore |
2024 |
VLDB |
6.9177653e-05 |
| 4,523 |
ScaleStore: A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA |
2022 |
SIGMOD |
6.1102901e-05 |
| 4,579 |
Virtual-Memory Assisted Buffer Management |
2023 |
SIGMOD |
6.0651118e-05 |
| 5,236 |
RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search |
2024 |
VLDB |
5.6077913e-05 |
| 6,202 |
Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs |
2024 |
VLDB |
5.1554849e-05 |
| 6,350 |
PQCache: Product Quantization-based KVCache for Long Context LLM Inference |
2025 |
SIGMOD |
5.0957601e-05 |
| 6,375 |
DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor Search |
2024 |
VLDB |
5.0868008e-05 |
| 6,838 |
LeanStore: A High-Performance Storage Engine for NVMe SSDs |
2024 |
VLDB |
4.906223e-05 |
| 8,683 |
TigerVector: Supporting Vector Search in Graph Databases for Advanced RAGs |
2025 |
SIGMOD |
4.4632232e-05 |
| 9,102 |
AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference |
2025 |
SIGMOD |
4.3916067e-05 |
| 9,677 |
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving |
2025 |
SIGMOD |
4.3006524e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 10,782 |
GaussDB-Vector: A Large-Scale Persistent Real-Time Vector Database for LLM Applications |
2025 |
VLDB |
4.1905499e-05 |
| 13,152 |
Database Perspective on LLM Inference Systems |
2025 |
VLDB |
- |
| 9,102 |
AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference |
2025 |
SIGMOD |
4.3916067e-05 |
| 10,066 |
DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention |
2026 |
SIGMOD |
4.1905499e-05 |
| 13,149 |
ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models |
2025 |
VLDB |
- |
| 10,170 |
From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation |
2026 |
SIGMOD |
4.1905499e-05 |
| 9,786 |
MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training |
2025 |
SIGMOD |
4.2799988e-05 |
| 10,020 |
HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems |
2026 |
SIGMOD |
4.1905499e-05 |
| 3,569 |
Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation |
2025 |
SIGMOD |
6.9588368e-05 |
| 6,350 |
PQCache: Product Quantization-based KVCache for Long Context LLM Inference |
2025 |
SIGMOD |
5.0957601e-05 |