Platforms & Practice
22 min
LoRA Is Not Cheap Full Fine-Tuning: What Low-Rank Adaptation Actually Changes
LoRA is usually explained as a budget approximation of full fine-tuning: same destination, less memory. Two lines of evidence say that framing is wrong. LoRA learns less, forgets less, and reaches a structurally different solutio…