Property LoraPlusRatio
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
LoraPlusRatio
LoRA+ learning-rate ratio: the zero-initialized B matrices train at this multiple of LearningRate while the A side keeps the base rate, which speeds convergence at unchanged memory. 16 is the commonly used value; 0 (the default) trains both sides at the base rate.
public float LoraPlusRatio { get; set; }