Method Load

Namespace

LMKit.Finetuning

Assembly

LM-Kit.NET.dll

Load(LM, string)

Loads a dataset from a file, auto-detecting the format from its extension and content. Supports .jsonl, .json (ShareGPT, Alpaca, chat, or prompt/completion pairs), .txt, and .zip.

public static TrainingDataset Load(LM model, string path)

Parameters

model LM

Model used to build conversation transcripts.

path string

Path to the dataset file.

Returns

TrainingDataset

Load(LM, Stream, TrainingDatasetFormat, string)

Loads a dataset from a stream with an explicit format.

public static TrainingDataset Load(LM model, Stream stream, TrainingDatasetFormat format, string fileName = null)

Parameters

model LM

stream Stream

format TrainingDatasetFormat

fileName string

Returns

TrainingDataset