Property AllowRecurrentMicroBatchSplit
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
AllowRecurrentMicroBatchSplit
Lets training split a sample across micro-batches on a model that carries a recurrent state (hybrid and recurrent architectures), which is refused by default. The training is then INEXACT: the gradient does not flow back through the recurrent state across a micro-batch boundary, so the earlier part of a split sample trains without the gradient its later part owes it. Use it only when every sample cannot fit one micro-batch in device memory and the inexact gradient is accepted. When set, the default micro-batch no longer grows to hold the longest sample, and a run that splits a sample says so once in the log. False (the default) keeps training exact.
public bool AllowRecurrentMicroBatchSplit { get; set; }