Tag: Fine-Tuning
-
Fine-Tuning vs Transfer Learning: What Actually Changes in a Model, and When to Use Each
Transfer learning is the umbrella; fine-tuning is one way to do it. A mechanism-first map of feature extraction, full tuning, PEFT, continued pretraining, instruction tuning, preference tuning, RAG,…
-
LoRA and QLoRA: Fine-Tuning Large Models on One GPU
LoRA fine-tunes 70B models on one GPU using low-rank weight updates. The intrinsic dimension proof, rsLoRA scaling fix, and where LoRA falls short.
You must be logged in to post a comment.