Class BeforeTokenSamplingEventArgs
- Namespace
- LMKit.TextGeneration.Events
- Assembly
- LM-Kit.NET.dll
Provides details for the event that occurs before a token sampling operation.
public sealed class BeforeTokenSamplingEventArgs : EventArgs- Inheritance
-
BeforeTokenSamplingEventArgs
- Inherited Members
Remarks
The event is triggered before the application of optional repetition penalties and the subsequent execution of the sampling process.
Properties
- GeneratedTokens
Retrieves a read-only collection of tokens that have been generated by the model up to this point.
- Logits
An array of logit values representing the unnormalized log probabilities of all tokens.
- Model
Gets the Model instance associated with this object.
- NextTokenLogitBias
A LogitBias object designed to adjust the likelihood of particular tokens (or text chunks) selection for the next text completion.
- RepetitionPenalty
Retrieves the current repetition penalty settings applied to prediction generation.
These settings can be modified to refine the behavior of subsequent sampling operations.
- SamplingMode
Gets the current token sampling engine utilized for generating predictions.
It is possible adjust its parameter to fine-tune the next sampling operation.
- Stop
A flag indicating whether the text completion process should be terminated prematurely.
Methods
- GetTokenCandidateByRank(int)
Retrieves the identifier of a token based on its rank in terms of likelihood of occurrence, prior to the application of any sampling methods.