Property RankGateFeedForwardNorm

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

RankGateFeedForwardNorm

Represents the rank for the LoRA adaptation of the gate tensor in the feed-forward network. Allows for specific customization of gating mechanisms within the model.

public int RankGateFeedForwardNorm { get; set; }

Property Value

int

The default value is 4.