Property MaxSequences

Namespace

LMKit.Global

Assembly

LM-Kit.NET.dll

MaxSequences

Most inputs one shared decode pass may carry. Defaults to 32, clamped to [1, 64].

public int MaxSequences { get; set; }

Property Value

int

Remarks

This bounds coalescing, not concurrency: any number of requests may be waiting, and each decode packs at most this many of their inputs (each an independent sequence) into one pass. Reading answers with the inherited value while MaxSequencesOverride is null; assigning sets the override.