Property AttachmentPrefillMemorySize
AttachmentPrefillMemorySize
Gets the device bytes of the attachment prefill context serving this slot pool, or
0 when there is none right now (the pool has no image-bearing prompt to prefill,
or the context was released while the pool was idle). A slot pool prefills the head of
an attachment prompt (its text and every image through the last one) on this separate
context while its slots keep generating, then hands the finished cells to the slot. It
is sized to the longest head it has prefilled, not to the slot window, and is created
again by the next attachment prompt once released. Not included in
MemorySize.
public long AttachmentPrefillMemorySize { get; }