Property TokenCount

Namespace

LMKit.TextGeneration.Sampling

Assembly

LM-Kit.NET.dll

TokenCount

Specifies the lookback window size, in tokens, for applying repetition penalties.
Only tokens within this window are considered when calculating penalties.
One token is roughly equivalent to 4 characters in standard English text.
Use a value within the range [0, 2048].
Use 0 to disable all repetition penalties.

public int TokenCount { get; set; }

Property Value

int

The default value is 0 (disabled).