Class LLM.TensorDistribution

Namespace

LMKit.Model

Assembly

LM-Kit.NET.dll

Represents the distribution of model layers or rows across multiple GPUs.

public sealed class LLM.TensorDistribution

Inheritance

object

LLM.TensorDistribution

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

TensorDistribution(IEnumerable<float>, bool)

Initializes a new instance of the LLM.TensorDistribution class.

Properties

Length

Gets the number of splits, which corresponds to the max number of possible GPUs.

RowMode

Gets a value indicating whether the distribution is in row mode. If false, the distribution mode is per layer.