SPRA-LoRA Freezes LoRA Adapters to Cut Federated Fine-Tuning Costs
A federated LoRA method freezes and resamples adapter matrices and uses rank-aware learning rates, cutting client overhead by half. It proposes SPRA-LoRA.
Try in Readerfederated learninglorafine-tuningspra-lora