Property RankUpFeedForwardNorm

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

RankUpFeedForwardNorm

Represents the rank for the LoRA adaptation of the up projection tensor in the feed-forward network. Allows for detailed customization of how features are projected back to the original dimension.

public int RankUpFeedForwardNorm { get; set; }

Property Value

int

The default value is 4.