Property PlacementDevices
PlacementDevices
Gets the GPU device numbers that hold this model's tensors, in ascending order: the main GPU alone for a single-device placement, every device of the layer split when the model is spread over several GPUs. Empty when the model resides in host memory.
public IReadOnlyList<int> PlacementDevices { get; }
Property Value
Remarks
Every per-device consumer of the model (contexts, slot pools, training runs) allocates on each device listed here, so a host that reports or budgets device memory per model reads this list rather than MainGpu, which names one device of a spread.