Property ContextSize

Namespace

LMKit.Global

Assembly

LM-Kit.NET.dll

ContextSize

Token window of the pool: both the longest single input it embeds in one pass and the packing budget of one shared decode. Defaults to 4096. Values below 256 are raised to 256; the model's own trained window caps it at attach.

public int ContextSize { get; set; }

Property Value

int

Remarks

This is ONE window for the whole pool, not a per-request share: pending inputs whose combined length fits it decode together, each as its own sequence. An input longer than the window is split into window-sized chunks whose vectors are mean-pooled, so raising this trades memory for single-pass fidelity on long inputs. Reading answers with the inherited value while ContextSizeOverride is null; assigning sets the override.