PQCache: Product Quantization-based KVCache for Long Context LLM Inference

Summary: PQCache uses PQ to compress KVCache for long-context LLM inference, treating KVCache as embedding retrieval. During prefilling and autoregressive decoding, PQ codes and centroids approximate key selection to fetch K/V, reducing overhead. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7319
Venue: SIGMOD
Year: 2025
Pagerank: 6.7091071e-05
Overall Rank: 4,430 | 69.61%
DOI: 10.1145/3725338

Incoming Non-self Citations Over Time

Authors

1. Hailin Zhang (Peking University)
2. Xiaodong Ji (Peking University)
3. Yilin Chen (Peking University)
4. Fangcheng Fu (Peking University)
5. Xupeng Miao (Purdue University)
6. Xiaonan Nie (Peking University)
7. Weipeng Chen (Baichuan Inc.)
8. Bin Cui (Peking University)

BibTeX Citation

@inproceedings{zhang_sigmod25,
        title = {{PQCache: Product Quantization-based KVCache for Long Context LLM Inference}},
        author = {Zhang, Hailin and Ji, Xiaodong and Chen, Yilin and Fu, Fangcheng and Miao, Xupeng and Nie, Xiaonan and Chen, Weipeng and Cui, Bin},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725338},
        url = {https://dl.acm.org/doi/10.1145/3725338},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,432	RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference	2026	VLDB	5.8801533e-05
6,900	Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving	2025	SIGMOD	5.7430032e-05
7,826	AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference	2025	SIGMOD	5.53654e-05
10,259	KVDrive: A Holistic Multi-Tier KV Cache Management System for Long-Context LLM Inference	2026	SIGMOD	5.093636e-05
10,297	TaCo: Data-adaptive and Query-aware Subspace Collision for High-dimensional Approximate Nearest Neighbor Search	2026	SIGMOD	5.093636e-05
10,357	DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
93	Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graph	2019	VLDB	0.00034701237
805	Cache locality is not enough: High-Performance Nearest Neighbor Search with Product Quantization Fast Scan	2016	VLDB	0.00013891999
857	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.00013568886
1,357	RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Search	2024	SIGMOD	0.00011043994
2,534	ELPIS: Graph-Based Similarity Search for Scalable Data Science	2023	VLDB	8.4561875e-05
2,572	DeltaPQ: Lossless Product Quantization Code Compression for High Dimensional Similarity Search	2020	VLDB	8.4027322e-05
7,005	Effective and Efficient Retrieval of Structured Entities	2020	VLDB	5.7269998e-05
7,492	Scalable Distributed Inverted List Indexes in Disaggregated Memory	2024	SIGMOD	5.6047664e-05
8,622	Accelerating Product Quantization Query Execution Runtime	2021	SIGMOD	5.3985954e-05
9,520	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB	5.2561283e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,900	Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving	2025	SIGMOD
2	13,291	OrbitFlow: SLO-Aware Long-Context LLM Serving with Fine-Grained KV Cache Reconfiguration	2026	VLDB
3	10,459	From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation	2026	SIGMOD
4	10,191	AlignedServe: Orchestrating Prefix-aware Batching to Build a High-throughput and Computing-efficient LLM Serving System	2026	SIGMOD
5	13,340	ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models	2025	VLDB
6	10,357	DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention	2026	SIGMOD
7	6,788	HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems	2026	SIGMOD
8	6,432	RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference	2026	VLDB
9	2,816	Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation	2025	SIGMOD
10	10,259	KVDrive: A Holistic Multi-Tier KV Cache Management System for Long-Context LLM Inference	2026	SIGMOD