Table of Contents

Property TrackedSessions

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

TrackedSessions

Gets the number of conversations the sharing parallel decoder is tracking on this context, those holding a sequence and those whose state has been moved off-device together, or 0 when SlotCount is 0. Exceeding SlotCount is expected: the resident set is bounded by the pool, the number of live conversations it serves is not.

public int TrackedSessions { get; }

Property Value

int
Share