Property EnableDuplicateSuppression
- Namespace
- LMKit.Retrieval.ChunkQuality
- Assembly
- LM-Kit.NET.dll
EnableDuplicateSuppression
Enables per-document duplicate suppression: a chunk whose normalized text was already seen in the same document (repeated headers, footers, boilerplate) is dropped as RepeatedBoilerplate, keeping only the first occurrence. Default: true.
public bool EnableDuplicateSuppression { get; set; }