Method GetLookupCacheEntryCount
GetLookupCacheEntryCount()
Gets the number of entries currently held in this model's rebuildable lookup
caches: cached tokenization results plus cached embedding lookups. This is what
ClearLookupCaches() would drop. Returns 0 when the caches are
empty. Reading it never disposes weights or contexts and never mutates inference
state, so it is safe to call on a live model to report how much a reclaim would
free before performing one.
public int GetLookupCacheEntryCount()Returns
- int
The combined tokenization and embedding lookup-cache entry count.