Table of Contents

Class LMKitChatClient

Namespace
LMKit.Integrations.ExtensionsAI.ChatClient
Assembly
LM-Kit.NET.Integrations.ExtensionsAI.dll

Implements Microsoft.Extensions.AI.IChatClient from Microsoft.Extensions.AI using LMKit's local inference engine. Supports non-streaming and streaming chat completions, tool/function calling, and configurable sampling parameters.

public sealed class LMKitChatClient : IChatClient, IDisposable
Inheritance
LMKitChatClient
Implements
IChatClient
Inherited Members

Constructors

LMKitChatClient(LM, ChatOptions?)

Initializes a new instance of the LMKitChatClient class.

Properties

Metadata

Methods

Dispose()
GetResponseAsync(IEnumerable<ChatMessage>, ChatOptions?, CancellationToken)

Sends chat messages and returns the response.

GetService(Type, object?)

Asks the Microsoft.Extensions.AI.IChatClient for an object of the specified type serviceType.

GetStreamingResponseAsync(IEnumerable<ChatMessage>, ChatOptions?, CancellationToken)

Sends chat messages and streams the response.