Property ContextSize

Namespace

LMKit.Hardware

Assembly

LM-Kit.NET.dll

ContextSize

Gets the context size (in tokens) that was determined to fit in available device memory.

public uint ContextSize { get; }

Property Value

uint

Remarks

This value may be smaller than the originally requested context size if the fitting process had to reduce it to fit available memory. If Success is false, this value is 0.