Table of Contents

Property QueuedRuns

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

QueuedRuns

Gets the number of requests admitted to the sharing parallel decoder and waiting for a free slot, or 0 when SlotCount is 0. A standing queue beside fully busy slots is the signal that the context is slot-bound.

public int QueuedRuns { get; }

Property Value

int
Share