Table of Contents

Property Decay

Namespace
LMKit.TextGeneration.Sampling
Assembly
LM-Kit.NET.dll

Decay

Specifies how much history the running average keeps: roughly 1 / (1 - decay) tokens.
Lower values react faster to a run of over- or under-confident picks; higher ones hold a steadier aim.
Use a floating-point value within the range [0, 0.99].

public float Decay { get; set; }

Property Value

float

The default value is 0.9, about ten tokens of history.

Share