Method AddDatasetFile
- Namespace
- LMKit.Finetuning
- Assembly
- LM-Kit.NET.dll
AddDatasetFile(string)
Loads a dataset file (JSONL, ShareGPT, Alpaca, prompt/completion pairs, plain text, or a ZIP archive of these) and adds all of its samples. Format is auto-detected.
public int AddDatasetFile(string path)
Parameters
pathstring
Returns
- int
The number of samples added.
Exceptions
- FinetuningException
The dataset declares images but none of them could be resolved: training would silently proceed text-only otherwise.
AddDatasetFile(string, out string)
Loads a dataset file exactly like AddDatasetFile(string), and additionally
reports what the loader had to skip. A zero return with a non-null
skipSummary is a format mismatch, not an empty file; the summary
names the supported shapes so the caller's error message is actionable.
public int AddDatasetFile(string path, out string skipSummary)
Parameters
pathstringPath to the dataset file.
skipSummarystringA one-sentence description of the skipped entries, or null when nothing was skipped.
Returns
- int
The number of samples added.