Table of Contents

Namespace LMKit.Model

Classes

LLM

A class designed to manage instances of Large Language Models (LLMs) in GGUF format.

LLM.DeviceConfiguration

Handles the underlying model device configuration, including GPU settings and memory management options.

LLM.LoadingOptions

Represents options for loading a model, allowing customization of the loading process.

LLM.Metadata

Represents metadata information associated with a model.

LLM.MetadataCollection

Represents a collection of Metadata objects.

LLM.TensorDistribution

Represents the distribution of model layers or rows across multiple GPUs.

Enums

LLM.Precision

Represents the different precision types for LLM models.

LLM.RopeType

Specifies the type of rope algorithm used for positional encoding in models.

LLM.TemplateFormat

Defines the possible formats for model chat templates, indicating specific structures and encoding standards used for chatbot interactions.

LLM.TemplateFormatFlags

Specifies flags that control how template formats handle system messages and suffixes when generating prompts for language models.

Delegates

LLM.ModelDownloadingProgressCallback

A delegate designed to monitor and report the progress of model downloading.

LLM.ModelLoadingProgressCallback

A delegate designed to monitor and report the progress of model loading.