Class InferencePolicies
Represents the configuration policies for inference processes.
public class InferencePolicies
- Inheritance
-
InferencePolicies
- Inherited Members
Properties
- ContextOverflowPolicy
Gets or sets the strategy to handle scenarios when the context exceeds its allowed size. This property determines the approach to be taken when the context overflows, based on the selected ContextOverflowPolicy.
- InputLengthOverflowPolicy
Gets or sets the strategy to adopt when the input length exceeds the context size. This property determines how the system should handle situations where the input exceeds the allowed length, based on the selected InputLengthOverflowPolicy.