Class LMKitChatClient
- Namespace
- LMKit.Integrations.ExtensionsAI.ChatClient
- Assembly
- LM-Kit.NET.Integrations.ExtensionsAI.dll
Implements Microsoft.Extensions.AI.IChatClient from Microsoft.Extensions.AI using LMKit's local inference engine. Supports non-streaming and streaming chat completions, tool/function calling, and configurable sampling parameters.
public sealed class LMKitChatClient : IChatClient, IDisposable
- Inheritance
-
LMKitChatClient
- Implements
-
IChatClient
- Inherited Members
Constructors
- LMKitChatClient(LM, ChatOptions?)
Initializes a new instance of the LMKitChatClient class.
Properties
Methods
- GetResponseAsync(IEnumerable<ChatMessage>, ChatOptions?, CancellationToken)
Sends chat messages and returns the response.
- GetService(Type, object?)
Asks the Microsoft.Extensions.AI.IChatClient for an object of the specified type
serviceType.
- GetStreamingResponseAsync(IEnumerable<ChatMessage>, ChatOptions?, CancellationToken)
Sends chat messages and streams the response.