Table of Contents

Property FirstLayer

Namespace
LMKit.Finetuning
Assembly
LM-Kit.NET.dll

FirstLayer

First transformer block that receives adapters, inclusive. 0 (the default) starts at the first block. Restricting the trainable range cuts adapter memory and backward compute proportionally; the last blocks carry most task-specific behavior, so a range covering the last third often keeps most of the quality.

public int FirstLayer { get; set; }

Property Value

int
Share