Field EnableKVCacheRecycling
Gets or sets a value indicating whether KV (key-value) cache recycling is enabled. KV cache recycling can help reduce memory footprint and improve performance.
public static bool EnableKVCacheRecycling
Returns
- bool
trueif KV cache recycling is enabled; otherwise,false. Default istrue.