Property WeirdCharRatio
- Namespace
- LMKit.Retrieval.ChunkQuality
- Assembly
- LM-Kit.NET.dll
WeirdCharRatio
Fraction of non-whitespace characters that essentially never occur in natural prose in any language (C1 controls, box-drawing and geometric symbols, spacing modifier soup, currency/dingbat noise). The strongest single indicator of binary extraction noise; clean text measures 0.
public double WeirdCharRatio { get; }