Class Quantizer

Namespace

LMKit.Quantization

Assembly

LM-Kit.NET.dll

Provides functionality for quantizing LLM models.

public sealed class Quantizer

Inheritance

object

Quantizer

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

Quantizer(string)

Initializes a new instance of the Quantizer class with the specified model path.

Properties

ThreadCount

Gets or sets the number of threads to be used for processing.
Ensures that the thread count is always at least 1 to prevent invalid configurations.

Methods

Quantize(string, Precision, bool, MetadataCollection)

Quantizes the model specified by Quantizer(string) and saves the quantized model to the specified destination file.