Property TotalContextSize
TotalContextSize
Tokens the pool's context holds in total, derived from the slot shape. Excludes the runtime's own staging reserve.
public int TotalContextSize { get; }
Tokens the pool's context holds in total, derived from the slot shape. Excludes the runtime's own staging reserve.
public int TotalContextSize { get; }