Snakes and Ladders: Accelerating SSM Inference with Speculative Decoding.

Mon, 01 Jan 2024 00:00:00 +0100

Yangchao Wu, Yonatan Dukler, Matthew Trager, Alessandro Achille, Wei Xia, Stefano Soatto:
Snakes and Ladders: Accelerating SSM Inference with Speculative Decoding. ENLSP 2024: 292-304