Training and fine-tuning
-
LoRA, QLoRA or a full fine-tune: how to choose
Full fine-tuning costs about 16 bytes per parameter, LoRA about 2, QLoRA…
-
Sizing VRAM: how batch size and context length decide whether your job runs
Weights, gradients and optimizer state you can calculate exactly. Activations depend on…
-
Why fine-tunes fail in production, and it is rarely the model
A model that scored well can still fail in front of users.…
-
Evaluating a fine-tune before you ship it
Training loss tells you the model fit your data, not that it…
-
Fitting a bigger training run on the GPU you already have
Out of memory does not always mean you need a bigger card.…
-
Building a dataset worth the GPU hours
The dataset sets the ceiling; compute only decides how fast you reach…
