Property OutputBufferBytes
OutputBufferBytes
Gets the size, in bytes, of the context's output/logits buffer, allocated apart
from the KV-cache and compute buffers and therefore not counted in
MemorySize. This buffer scales with the model's vocabulary size and
can be a substantial per-context allocation for large-vocabulary models. Returns
0 when the context is hibernated, or when the running native backend predates
the query export (older redistributable binaries), in which case the bytes fall into
the dashboard's unattributed bucket rather than being mis-reported.
public long OutputBufferBytes { get; }