HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems

Summary: HotPrefix: hotness-aware KV-cache scheduler that tracks long-tail prefix reuse and pins hot prefixes in GPU HBM while offloading cold prefixes to CPU RAM. Overlaps KV transfers with computation to avoid redundant KV recomputation, cut HBM pressure, and boost latency/throughput for shared-prefix LLM inference. (summarized by gpt-5-mini on Feb 11 2026)

Paper ID: 7325
Venue: SIGMOD
Year: 2026
Pagerank: 4.1945683e-05
Overall Rank: 10,020 | 30.30%
DOI: 10.1145/3749168

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
695	2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm	1994	VLDB	0.00018061376

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,135	ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models	2025	VLDB	-
10,143	Beluga: A CXL-Based Memory Architecture for Scalable and Efficient LLM KVCache Management	2026	SIGMOD	4.1945683e-05
13,138	Database Perspective on LLM Inference Systems	2025	VLDB	-
13,088	OrbitFlow: SLO-Aware Long-Context LLM Serving with Fine-Grained KV Cache Reconfiguration	2026	VLDB	-
10,222	RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference	2026	VLDB	4.1945683e-05
10,170	From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation	2026	SIGMOD	4.1945683e-05
10,066	DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention	2026	SIGMOD	4.1945683e-05
9,677	Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving	2025	SIGMOD	4.3047774e-05
3,565	Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation	2025	SIGMOD	6.9655362e-05
6,357	PQCache: Product Quantization-based KVCache for Long Context LLM Inference	2025	SIGMOD	5.0970739e-05