Enum LM.RopeType
Specifies the type of rope algorithm used for positional encoding in models.
public enum LM.RopeType
Fields
NONE = -1No positional encoding.
NORM = 0Standard positional encoding.
NEOX = 2NeoX positional encoding.
MROPE = 8Multimodal rotary position embedding.
VISION = 24Vision encoding.
IMROPE = 40Interleaved multimodal rotary position embedding.