Namespace LMKit.Hardware
Namespaces
Classes
- DeviceConfiguration
Provides methods for configuring device-related settings based on GPU hardware capabilities.
- MemoryEstimation
Provides methods for estimating memory requirements and fitting model and context parameters to available device memory using llama.cpp's native memory estimation.
- MemoryEstimation.FitResult
Represents the result of a memory fitting operation.
Enums
- DeviceType
Enumerates device types used for compute/graphics processing.