"PQCache: Product Quantization-based KVCache for Long Context LLM Inference."

Hailin Zhang et al. (2024)

Details and statistics

DOI: 10.48550/ARXIV.2407.12820

access: open

type: Informal or Other Publication

metadata version: 2024-08-22

a service of  Schloss Dagstuhl - Leibniz Center for Informatics