Table of Contents

Property ContextOverflowPolicy

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

ContextOverflowPolicy

Gets or sets the strategy to handle scenarios when the context exceeds its allowed size. This property determines the approach to be taken when the context overflows, based on the selected ContextOverflowPolicy.

public ContextOverflowPolicy ContextOverflowPolicy { get; set; }

Property Value

ContextOverflowPolicy

The default value is KVCacheShifting