Property ExcludeTopChoicesProbability

Namespace

LMKit.TextGeneration.Sampling

Assembly

LM-Kit.NET.dll

ExcludeTopChoicesProbability

Specifies how often the most predictable candidates are REMOVED, leaving a still-likely alternative to be sampled instead.

public float ExcludeTopChoicesProbability { get; set; }

Property Value

float

The default value is 0 (disabled).

Remarks

Every other filter here removes unlikely candidates, which raises coherence and lowers variety. This one does the opposite, and is the reason it can break a model out of cliches and stock phrasings without the incoherence that raising temperature brings: what remains was still judged likely.

Applied on this fraction of tokens only. Use 0 to disable; 0.5 is the common setting.