Property TopNSigma

Namespace

LMKit.TextGeneration.Sampling

Assembly

LM-Kit.NET.dll

TopNSigma

Keeps only candidates whose pre-softmax score is within this many standard deviations of the best one.
Because the cut is measured on raw scores, it holds steady as Temperature changes, which is what makes higher temperatures usable on reasoning tasks.
Use 0 to disable.

public float TopNSigma { get; set; }

Property Value

float

The default value is 0 (disabled). A value of 1 is a tight, focused cut.

Remarks

Described in "Top-nσ: Not All Logits Are You Need" https://arxiv.org/pdf/2411.07641