Table of Contents

Constructor TensorDistribution

Namespace
LMKit.Model
Assembly
LM-Kit.NET.dll

TensorDistribution(IEnumerable<float>, bool)

Initializes a new instance of the LLM.TensorDistribution class.

public TensorDistribution(IEnumerable<float> splits, bool rowMode = false)

Parameters

splits IEnumerable<float>

Each entry specifies the proportion of layers to allocate to the GPU, specified by the index.

rowMode bool

Indicates whether the distribution should be in row mode.