Namespace LMKit.Inference
Classes
- InferencePolicies
Represents the configuration policies for inference processes.
Enums
- ContextOverflowPolicy
Specifies strategies to handle scenarios when the context exceeds its allowed size.
- InferenceModality
Specifies which modality (or combination of modalities) should be used when performing inference on the input data.
- InputLengthOverflowPolicy
Defines strategies to adopt when the prompt length exceeds the context size.