Property EpsilonCutoff
- Namespace
- LMKit.TextGeneration.Sampling
- Assembly
- LM-Kit.NET.dll
EpsilonCutoff
Specifies an ABSOLUTE probability floor: candidates below it are dropped whatever the
rest of the distribution looks like.
Use 0 to disable.
public float EpsilonCutoff { get; set; }Property Value
- float
The default value is 0 (disabled). Values around 0.0003 are typical.
Remarks
Described in "Truncation Sampling as Language Model Desmoothing" https://arxiv.org/abs/2210.15191