Enum ContextOverflowPolicy

Namespace

LMKit.Inference

Assembly

LM-Kit.NET.dll

Specifies strategies to handle scenarios when the context exceeds its allowed size.

public enum ContextOverflowPolicy

Fields

KVCacheShifting = 0

Dynamically adjusts the key-value cache to accommodate the overflow. This approach ensures continued processing by shifting the cache contents.

StopGeneration = 1

Returns ContextSizeLimitExceeded when the context is full. This strategy halts the processing and signals an error condition.