Property HasKVCache

Namespace

LMKit.Inference

Assembly

LM-Kit.NET.dll

HasKVCache

Gets a value indicating whether the context keeps a KV-cache. A model whose attention spans each pass alone (a bidirectional encoder or a pooled embedding model) keeps none: its MemorySize is compute buffers only, sized by the tokens one pass carries rather than by ContextLength, and KVCacheQuantization does not apply.

public bool HasKVCache { get; }

Property Value

bool