Table of Contents

Property UseRsLora

Namespace
LMKit.Finetuning
Assembly
LM-Kit.NET.dll

UseRsLora

Rank-stabilized LoRA: scales the adapter by alpha divided by the square root of the rank instead of alpha divided by the rank, which keeps higher ranks from training with a vanishing effective scale. The scaling is folded into the saved adapter, so artifacts stay compatible with every consumer.

public bool UseRsLora { get; set; }

Property Value

bool
Share