Property AdamBeta1

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

AdamBeta1

Gets or sets the exponential decay rate for the first moment estimates in the Adam optimizer. This rate controls how quickly the contributions from previous gradients diminish.

public float AdamBeta1 { get; set; }

Property Value

float

The default value is 0.9.

Remarks

A higher beta1 value gives more weight to older gradients, making the optimizer less responsive to recent changes. Typically set close to 1.