Property Allocation
Allocation
When the pool claims its memory. Defaults to OnFirstCompletion, so a process that loads an embedding model and never embeds reserves nothing.
public SharedSlotPoolOptions.AllocationTiming Allocation { get; set; }When the pool claims its memory. Defaults to OnFirstCompletion, so a process that loads an embedding model and never embeds reserves nothing.
public SharedSlotPoolOptions.AllocationTiming Allocation { get; set; }