Property MicroBatchSize
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
MicroBatchSize
Tokens evaluated per training micro-batch. Activation memory scales linearly with this, so it is the first lever when a run does not fit device memory; larger values run faster when memory allows. 0 (the default) picks 512 or 256 to divide the window. The value snaps down to the nearest power of two that divides the resolved window.
public int MicroBatchSize { get; set; }