Table of Contents

Field EnableKVCacheRecycling

Namespace
LMKit.Global
Assembly
LM-Kit.NET.dll

Gets or sets a value indicating whether KV (key-value) cache recycling is enabled. KV cache recycling can help reduce memory footprint and improve performance.

public static bool EnableKVCacheRecycling

Returns

bool

true if KV cache recycling is enabled; otherwise, false. Default is true.