Enum HibernationMode
Controls when the runtime hibernates an inference context at the
end of a conversation turn. The mode is set on
HibernationMode by the owning conversation
(e.g. MultiTurnConversation, PdfChat) and consulted
by the inference backend every time a usage lock is released.
public enum HibernationMode
Fields
Auto = 0Default. Reserved for runtime-driven heuristics. Currently behaves like None; future versions may hibernate when the host approaches a memory threshold or when a session has been idle for a configurable period.
None = 1No explicit hibernation. The runtime keeps the context resident in memory between turns; callers may still trigger hibernation manually via HibernateAsync(string).
Forced = 2At the end of every conversation turn, the runtime schedules HibernateAsync(string) as a fire-and-forget background task: the caller does not wait for the KV-cache to land on disk, and the next turn rehydrates the context transparently from the on-disk image.