Property Tokens

Namespace

LMKit.Data

Assembly

LM-Kit.NET.dll

Tokens

Gets a read-only list of tokens that represent the processed form of the text in this partition.
These tokens are derived from the text based on the embeddings model used.

public IReadOnlyList<int> Tokens { get; }

Property Value

IReadOnlyList<int>