Property RankDownFeedForwardNorm

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

RankDownFeedForwardNorm

Represents the rank for the LoRA adaptation of the down projection tensor in the feed-forward network. Enhances the model’s ability to project input features to a lower dimensional space.

public int RankDownFeedForwardNorm { get; set; }

Property Value

int

The default value is 4.