Property ScratchContextsTrimmed

Namespace

LMKit.Inference

Assembly

LM-Kit.NET.dll

ScratchContextsTrimmed

Gets the number of inference contexts whose backend scratch was returned: temporaries the backend keeps at the largest size any decode ever requested, outside the context's own KV and compute buffers.

public int ScratchContextsTrimmed { get; }

Property Value

int