Property AdamBeta2

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

AdamBeta2

Gets or sets the exponential decay rate for the second moment estimates in the Adam optimizer. This parameter helps stabilize the update steps across all parameters by normalizing gradient variances.

public float AdamBeta2 { get; set; }

Property Value

float

The default value is 0.999.

Remarks

A higher beta2 value helps in maintaining a more stable, but less responsive, optimization process over larger gradients and variances.