LlmHealthIndicator

org.llm4s.spring.LlmHealthIndicator
final class LlmHealthIndicator(client: JLlmClient, settings: HealthSettings, executor: ExecutorService, nanoClock: () => Long) extends HealthIndicator

Reports what was actually checked. By default (llm4s.health.probe=false) it makes no provider call: it is UP with probe=disabled and the provider and model names, meaning "configured", not "reachable". With llm4s.health.probe=true it sends a one-token completion on executor, waits at most llm4s.health.probe-timeout, and caches the outcome for llm4s.health.probe-ttl. A failed or timed-out probe is DOWN with a redacted message.

Attributes

Graph
Supertypes
trait HealthIndicator
trait HealthContributor
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

override def health(): Health

Attributes

Definition Classes
HealthIndicator

Inherited methods

def getHealth(includeDetails: Boolean): Health

Attributes

Inherited from:
HealthIndicator