Class LLM.DeviceConfiguration

Namespace

LMKit.Model

Assembly

LM-Kit.NET.dll

A class designed to handle underlying model device configuration, including GPU settings and memory management options.

public sealed class LLM.DeviceConfiguration

Inheritance

object

LLM.DeviceConfiguration

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

DeviceConfiguration()

Initializes a new instance of the DeviceConfiguration class, setting default values for GPU configuration and memory management options.

Properties

GpuLayerCount

Gets or sets the number of layers to process on the GPU, optimizing performance by leveraging available VRAM (GPU memory).

MainGpu

Specifies the main GPU device used for scratch and small tensors.