Table of Contents

Method Decode

Namespace
LMKit.Tokenization
Assembly
LM-Kit.NET.dll

Decode(IEnumerable<int>)

Decodes a sequence of token identifiers into a human-readable string. Special tokens (beginning and end of sequence) are skipped.

public string Decode(IEnumerable<int> tokens)

Parameters

tokens IEnumerable<int>

A collection of token identifiers.

Returns

string

The decoded string.