Table of Contents

Method ReleaseRetainedSessionState

Namespace
LMKit.Model
Assembly
LM-Kit.NET.dll

ReleaseRetainedSessionState(out long)

Discards the retained states of every idle conversation, in host memory and on disk, across every loaded model, and returns the number of conversations released.

public static int ReleaseRetainedSessionState(out long reclaimedBytes)

Parameters

reclaimedBytes long

Receives the host memory, in bytes, the released states held.

Returns

int

The number of conversations whose retained state was released.

Remarks

Safe on a busy process: a conversation being decoded holds its state on the device, not here, and is never touched. A released conversation keeps its history and resumes normally; its next turn reprocesses that history instead of restoring it.

Share