Namespace LMKit.Model
Classes
- LLM
A class designed to manage instances of Large Language Models (LLMs) in GGUF format.
- LLM.DeviceConfiguration
A class designed to handle underlying model device configuration, including GPU settings and memory management options.
- LLM.LoadingOptions
Represents options for loading a model, allowing customization of the loading process.
- LLM.Metadata
Represents metadata information associated with a model.
- LLM.MetadataCollection
Represents a collection of Metadata objects.
- LLM.TensorDistribution
Represents the distribution of model layers or rows across multiple GPUs.
Enums
- LLM.Precision
Represents the different precision types for LLM models.
- LLM.RopeType
Specifies the type of rope algorithm used for positional encoding in models.
- LLM.TemplateFormat
Defines the possible formats for model chat templates, indicating specific structures and encoding standards used for chatbot interactions.
Delegates
- LLM.ModelDownloadingProgressCallback
A delegate designed to monitor and report the progress of model downloading.
- LLM.ModelLoadingProgressCallback
A delegate designed to monitor and report the progress of model loading.