Namespace LMKit.Inference
Classes
- InferencePolicies
Represents the configuration policies for inference processes.
Enums
- ContextOverflowPolicy
Specifies strategies to handle scenarios when the context exceeds its allowed size.
- InputLengthOverflowPolicy
Defines strategies to adopt when the prompt length exceeds the context size.