8B Model Outperforms LoRA in Continual Learning Experiments
A new experiment shows an 8B model retaining 90.7% accuracy on news data, significantly outperforming LoRA methods which suffer from catastrophic forgetting.
Try in Readercontinual learningmachine learninglora
