Method IsRepeatedAcrossDocuments

Namespace

LMKit.Retrieval.ChunkQuality

Assembly

LM-Kit.NET.dll

IsRepeatedAcrossDocuments(ulong)

Whether this chunk is known to repeat across enough distinct documents to be considered boilerplate. Returning true makes the session drop the chunk as RepeatedBoilerplate.

bool IsRepeatedAcrossDocuments(ulong normalizedTextHash)

Parameters

normalizedTextHash ulong

FNV-1a hash of the chunk's normalized embedding text.

Returns

bool