Class MemoryEstimation.FitResult
Represents the result of a memory fitting operation.
public sealed class MemoryEstimation.FitResult
- Inheritance
-
MemoryEstimation.FitResult
- Inherited Members
Properties
- ContextSize
Gets the context size (in tokens) that was determined to fit in available device memory.
- GpuLayerCount
Gets the number of GPU layers that was determined to fit in available device memory.
- Success
Gets a value indicating whether the parameters were successfully fitted to available device memory.