Back to papers
RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
Summary: RetroInfer rethinks KV-cache management for long-context LLM inference as a vector storage problem, offloading cache to CPU and retrieving only attention-relevant tokens. Its wave index and wave buffer jointly target sparse-attention accuracy/cost tradeoffs and GPU-CPU data movement, yielding full-attention accuracy with much higher throughput.
(summarized by gpt-5.4-mini on Apr 12 2026)
- Paper ID
- 14257
- Venue
- VLDB
- Year
- 2026
- Pagerank
- 5.1725247e-05
- Overall Rank
- 10,222 | 28.96%
- DOI
-
10.14778/3796195.3796212
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
Outgoing Citations (Sorted by Pagerank)
Showing 20 of 20 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 114 |
Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graph |
2019 |
VLDB |
0.00032660283 |
| 327 |
Milvus: A Purpose-Built Vector Data Management System |
2021 |
SIGMOD |
0.00021167935 |
| 1,176 |
PASE: PostgreSQL Ultra-High-Dimensional Approximate Nearest Neighbor Search Extension |
2020 |
SIGMOD |
0.00011910995 |
| 1,603 |
Manu: A Cloud Native Vector Database Management System |
2022 |
VLDB |
0.00010315993 |
| 1,768 |
High-Throughput Vector Similarity Search in Knowledge Graphs |
2023 |
SIGMOD |
9.8752116e-05 |
| 1,786 |
ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data |
2024 |
SIGMOD |
9.8397478e-05 |
| 1,902 |
HVS: Hierarchical Graph Structure Based on Voronoi Diagrams for Solving Approximate Nearest Neighbor Search |
2022 |
VLDB |
9.6061295e-05 |
| 2,199 |
Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces |
2023 |
VLDB |
9.0284127e-05 |
| 2,751 |
DeltaPQ: Lossless Product Quantization Code Compression for High Dimensional Similarity Search |
2020 |
VLDB |
8.2307473e-05 |
| 3,019 |
SingleStore-V: An Integrated Vector Database System in SingleStore |
2024 |
VLDB |
7.9093789e-05 |
| 3,727 |
ScaleStore: A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA |
2022 |
SIGMOD |
7.2310205e-05 |
| 3,996 |
Virtual-Memory Assisted Buffer Management |
2023 |
SIGMOD |
7.0409362e-05 |
| 4,560 |
RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search |
2024 |
VLDB |
6.6961568e-05 |
| 5,780 |
Chat2Data: An Interactive Data Analysis System with RAG, Vector Databases and LLMs |
2024 |
VLDB |
6.1547294e-05 |
| 5,809 |
DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor Search |
2024 |
VLDB |
6.1420277e-05 |
| 6,185 |
PQCache: Product Quantization-based KVCache for Long Context LLM Inference |
2025 |
SIGMOD |
6.0213899e-05 |
| 6,449 |
LeanStore: A High-Performance Storage Engine for NVMe SSDs |
2024 |
VLDB |
5.9336241e-05 |
| 8,509 |
TigerVector: Supporting Vector Search in Graph Databases for Advanced RAGs |
2025 |
SIGMOD |
5.4818126e-05 |
| 9,000 |
AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference |
2025 |
SIGMOD |
5.3991306e-05 |
| 9,661 |
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving |
2025 |
SIGMOD |
5.2956801e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 10,782 |
GaussDB-Vector: A Large-Scale Persistent Real-Time Vector Database for LLM Applications |
2025 |
VLDB |
5.1725247e-05 |
| 13,152 |
Database Perspective on LLM Inference Systems |
2025 |
VLDB |
- |
| 9,000 |
AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference |
2025 |
SIGMOD |
5.3991306e-05 |
| 10,066 |
DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention |
2026 |
SIGMOD |
5.1725247e-05 |
| 13,149 |
ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models |
2025 |
VLDB |
- |
| 10,170 |
From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation |
2026 |
SIGMOD |
5.1725247e-05 |
| 9,777 |
MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training |
2025 |
SIGMOD |
5.2743647e-05 |
| 10,020 |
HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems |
2026 |
SIGMOD |
5.1725247e-05 |
| 4,681 |
Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation |
2025 |
SIGMOD |
6.6286556e-05 |
| 6,185 |
PQCache: Product Quantization-based KVCache for Long Context LLM Inference |
2025 |
SIGMOD |
6.0213899e-05 |