SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modules.

Mon, 01 Jan 2024 00:00:00 +0100

Xiangyu Chen, Jing Liu, Ye Wang, Pu Perry Wang, Matthew Brand, Guanghui Wang, Toshiaki Koike-Akino:
SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modules. CoRR abs/2403.11887 (2024)