Property RankAttentionNorm

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

RankAttentionNorm

Represents the rank used for the attention norm tensor in the LoRA adaptation process. Overrides the default rank to enhance specificity. Typically, norm tensors use a rank of 1 to maintain normalization constraints.

public int RankAttentionNorm { get; set; }

Property Value

int

The default value is 1.