"FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous ..."

Jiaao He, Jidong Zhai (2024)

Details and statistics

DOI: 10.48550/ARXIV.2403.11421

access: open

type: Informal or Other Publication

metadata version: 2024-04-08

a service of  Schloss Dagstuhl - Leibniz Center for Informatics