Llm4sExecutors

org.llm4s.spring.Llm4sExecutors

Name of the executor bean behind completeAsync and the health probe; define a bean of this name to replace it.

Attributes

Source
Llm4sAutoConfiguration.scala
Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads.

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads.

Attributes

Source
Llm4sAutoConfiguration.scala

Concrete fields

final val BeanName: "llm4sTaskExecutor"

Attributes

Source
Llm4sAutoConfiguration.scala