Table of Contents

Method GetToken

Namespace
LMKit.Tokenization
Assembly
LM-Kit.NET.dll

GetToken(string)

Retrieves the token identifier corresponding to a given string value.

public int GetToken(string value)

Parameters

value string

The string value to search for in the vocabulary.

Returns

int

The zero-based index of the token if found; otherwise, -1.