Table of Contents

Property SlotContextSize

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

SlotContextSize

Gets the token window (prompt plus completion) one slot of the sharing parallel decoder reserves for a single request, or 0 when SlotCount is 0. This, not ContextLength, is the ceiling an individual request on this context can occupy.

public int SlotContextSize { get; }

Property Value

int
Share