Property EtaCutoff
- Namespace
- LMKit.TextGeneration.Sampling
- Assembly
- LM-Kit.NET.dll
EtaCutoff
Specifies an entropy-aware probability floor: the cut is
min(eta, sqrt(eta) * exp(-H)), so the same setting truncates a confident
prediction harder than an uncertain one.
Use 0 to disable.
public float EtaCutoff { get; set; }Property Value
- float
The default value is 0 (disabled). Values around 0.0003 are typical.
Remarks
Described in "Truncation Sampling as Language Model Desmoothing" https://arxiv.org/abs/2210.15191