Property TopA

Namespace

LMKit.TextGeneration.Sampling

Assembly

LM-Kit.NET.dll

TopA

Specifies diversity through Top-A sampling, whose threshold scales with the SQUARE of the best candidate's probability.
A confident prediction is therefore truncated hard and an uncertain one is left almost intact, which is what makes this a set-and-forget alternative to retuning TopP per prompt.
Use 0 to disable.

public float TopA { get; set; }

Property Value

float

The default value is 0 (disabled). Values around 0.2 are a common starting point.