Table of Contents

Property MemorySize

Namespace
LMKit.Inference
Assembly
LM-Kit.NET.dll

MemorySize

Gets the context's main KV-cache plus scheduler-managed compute-buffer size, in bytes. Returns 0 when the context is hibernated (its memory has been released to disk; see Residency). This does not include the draft context (see DraftMemorySize) or the output/logits buffer (see OutputBufferBytes); the full resident footprint of the session is MemorySize + DraftMemorySize + OutputBufferBytes.

public long MemorySize { get; }

Property Value

long
Share