Health

Liveness probe.#

Returns 200 OK when the server process is alive. Use this endpoint for container orchestration liveness checks (e.g. Kubernetes livenessProbe). This endpoint is always anonymous and does not require authentication.

Responses

curl -X GET "$LMKIT_ONE_URL/lmkit/v1/health" \
  -H "Authorization: Bearer $LMKIT_API_KEY"

Readiness probe.#

Returns 200 OK when the server is ready to accept inference requests, including infrastructure details (backend init state, loaded models, queue depth, active inferences). Answers 503 while the backend initializes, while configured warmup models are still loading ('warming'), and the moment a graceful shutdown begins ('draining'), so an orchestrator routes traffic only to nodes that can serve it. Requires the configured pre-shared bearer token because the response exposes internal runtime state. For Kubernetes readinessProbe use, configure the probe's httpHeaders to include the Authorization: Bearer … header. The queue_depth field also feeds KEDA's metrics-api scaler on Prometheus-less stacks.

Responses

curl -X GET "$LMKIT_ONE_URL/lmkit/v1/ready" \
  -H "Authorization: Bearer $LMKIT_API_KEY"