Table of Contents

Class InferencePolicies

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

Represents the configuration policies for inference processes.

public class InferencePolicies
Inheritance
InferencePolicies
Inherited Members

Properties

ContextOverflowPolicy

Gets or sets the strategy to handle scenarios when the context exceeds its allowed size. This property determines the approach to be taken when the context overflows, based on the selected ContextOverflowPolicy.

InputLengthOverflowPolicy

Gets or sets the strategy to adopt when the input length exceeds the context size. This property determines how the system should handle situations where the input exceeds the allowed length, based on the selected InputLengthOverflowPolicy.