Class DeviceConfiguration

Namespace

LMKit.Graphics

Assembly

LM-Kit.NET.dll

Provides methods for configuring device-related settings based on GPU hardware capabilities.

public static class DeviceConfiguration

Inheritance

object

DeviceConfiguration

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Remarks

This class helps determine optimal configuration values for graphics-related tasks by inspecting available GPU resources. Currently, it focuses on selecting a suitable GPU context size based on the available free GPU memory.

Methods

GetOptimalContextSize()

Determines the optimal GPU context size based on the currently available GPU device's free memory.

GetOptimalContextSize(LM)

Determines the optimal GPU context size based on the currently available GPU device's free memory, with an option to cap this size according to the specified language model.

GetPerformanceScore(LM)

Calculates a performance score for the provided language model based on the GPU device's total memory and the model's estimated memory requirements.

GetPerformanceScore(ModelCard)

Calculates a performance score for the provided model card based on the GPU device's total memory and the model's file size.