Property NeftuneAlpha
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
NeftuneAlpha
NEFTune noise alpha. When positive, training adds uniform noise scaled by alpha / sqrt(tokens x embedding width) onto the input embeddings of every training window, a regularizer that counters overfitting on small datasets. Validation passes always run without noise. Typical values are 5 to 15; 0 (the default) disables it.
public float NeftuneAlpha { get; set; }