Table of Contents

Property GradientAccumulation

Namespace
LMKit.Finetuning
Assembly
LM-Kit.NET.dll

GradientAccumulation

Samples accumulated per optimizer step: gradients from this many samples combine before the weights update, multiplying the effective batch size without growing memory. 1 (the default) steps on every sample.

public int GradientAccumulation { get; set; }

Property Value

int

Exceptions

ArgumentOutOfRangeException

Value is below 1.

Share