"QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving."

Yujun Lin et al. (2024)

Details and statistics

DOI: 10.48550/ARXIV.2405.04532

access: open

type: Informal or Other Publication

metadata version: 2024-06-13

a service of  Schloss Dagstuhl - Leibniz Center for Informatics