Property MaxGradNorm
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
MaxGradNorm
Gradient clipping by global norm: right before each optimizer step,
every gradient is scaled by MaxGradNorm / max(MaxGradNorm, norm),
where norm is the global L2 norm over all trainable gradients.
Outlier steps are rescaled; ordinary steps pass through unchanged.
Default 1.0. Set to 0 to disable clipping.
public float MaxGradNorm { get; set; }Property Value
Exceptions
- ArgumentOutOfRangeException
Value is negative.