Property IsPlacementDegraded

Namespace

LMKit.Model

Assembly

LM-Kit.NET.dll

IsPlacementDegraded

Indicates whether the model loaded with a degraded device placement: the device lacked free memory at load time, so fewer layers were offloaded to the GPU than requested (or the model fell back to CPU entirely where a split placement is unsafe).

public bool IsPlacementDegraded { get; }

Property Value

bool

true when the placement was reduced under memory pressure; otherwise, false.

Remarks

A degraded placement lasts for this instance's lifetime and typically costs substantial inference throughput. Hosts that keep models resident can watch this property and reload the model once the device has enough free memory to restore the requested placement. An identical load request that arrives while this instance is still alive shares its weights (and reports true here too) only while the device still cannot hold them whole; once it can, that request loads a fully placed copy of its own.