Table of Contents

Property PlacementDevices

Namespace
LMKit.Model
Assembly
LM-Kit.NET.dll

PlacementDevices

Gets the GPU device numbers that hold this model's tensors, in ascending order: the main GPU alone for a single-device placement, every device of the layer split when the model is spread over several GPUs. Empty when the model resides in host memory.

public IReadOnlyList<int> PlacementDevices { get; }

Property Value

IReadOnlyList<int>

Remarks

Every per-device consumer of the model (contexts, slot pools, training runs) allocates on each device listed here, so a host that reports or budgets device memory per model reads this list rather than MainGpu, which names one device of a spread.

Share