Enum ContextResidency
Tracks where the underlying inference context currently resides across its lazy-init / in-memory / hibernated lifecycle.
public enum ContextResidency
Fields
NotCreated = 0The native context has not been created yet. It will be allocated on first access.
InMemory = 1The native context is live in RAM and ready for inference.
Hibernated = 2The native context state has been serialized to disk to free memory. It will be rehydrated back into RAM on next access.
Remarks
The context is created on first use (lazy init) and can later be hibernated to disk to free RAM, then rehydrated on next access with its full state (including KV-cache) intact.