Table of Contents

Property BusySlots

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

BusySlots

Gets the number of slots decoding a request at the moment of the snapshot, or 0 when SlotCount is 0. Persistently far below SlotCount under load means requests are not reaching the decoder, not that the context is oversized.

public int BusySlots { get; }

Property Value

int
Share