Property SharedSlotPool

Namespace

LMKit.Model

Assembly

LM-Kit.NET.dll

SharedSlotPool

Gets or sets the slot-pool shape the loaded model is served at under SharedSlotPool, stated BEFORE its weights are placed.

public SharedSlotPoolOptions SharedSlotPool { get; set; }

Property Value

SharedSlotPoolOptions

Remarks

Every value stated here becomes the model's own setting on SharedSlotPool, exactly as if it had been assigned there after loading; unstated values keep inheriting from SharedSlotPool. The difference is timing: the pool is standing memory the model always carries, and stating its shape here lets the weights be placed where that pool fits beside them. With FavorDistributedInference enabled, a model whose weights fit one device but whose configured pool does not is spread over several devices at load, instead of keeping one device and having its pool fitted down. A shape assigned on SharedSlotPool after loading still applies, but the placement was decided without it.

Defaults to null: the placement is decided for the shape the model inherits from SharedSlotPool.