Class Configuration

Namespace: LMKit.Global

Assembly: LM-Kit.NET.dll

A static class providing global configuration settings for the LM-Kit runtime.

public static class Configuration

Inheritance: object

Configuration

Inherited Members: object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Fields

DownloadChunkSize: Gets or sets the size of the download chunks. This value determines the size of each chunk when downloading data.

EnableCompletionHealing: Gets or sets a value indicating whether completion healing is enabled. Completion healing attempts to correct errors during the completion process.

EnableContextRecycling: Gets or sets a value indicating whether context recycling is enabled. This helps in reusing context data to improve performance.

EnableContextTokenHealing: Gets or sets a value indicating whether context token healing is enabled. This setting helps in correcting errors in the context tokenization.

EnableKVCacheRecycling: Gets or sets a value indicating whether KV (key-value) cache recycling is enabled. KV cache recycling can help reduce memory footprint and improve performance.

EnableModelCache: Gets or sets a value indicating whether model caching is enabled. This helps in improving the performance by reusing models.

EnableTokenHealing: Gets or sets a value indicating whether token healing is enabled. Token healing attempts to correct errors in tokenization.

EnableTokenizationCache: Gets or sets a value indicating whether tokenization caching is enabled. Tokenization caching improves performance by storing the results of tokenization operations.

MaxCachedContextLength: Gets or sets the maximum length of cached context. This value determines the maximum length of context data that can be cached.

TokenizerCacheLength: Gets or sets the length of the tokenizer cache. This value determines how many tokens are stored in the cache.

Properties

MinContextSize: Gets or sets the minimum context size. This value determines the smallest context size allowed.

ThreadCount: Gets or sets the max number of threads to be used for processing. This value defaults to the number of physical cores available on the machine.