Enum LM.RopeType
Specifies the type of rope algorithm used for positional encoding in models.
public enum LM.RopeType
Fields
NONE = -1
No positional encoding.
NORM = 0
Standard positional encoding.
NEOX = 2
NeoX positional encoding.
MROPE = 8
Multimodal rotary position embedding.
VISION = 24
Vision encoding.