Llm4sExecutors

org.llm4s.spring.Llm4sExecutors

Name of the executor bean behind completeAsync and the health probe; define a bean of this name to replace it.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

def create(p: AsyncProperties): ExecutorService

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads so the module keeps working on JDK 17.

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads so the module keeps working on JDK 17.

Attributes

Concrete fields

final val BeanName: "llm4sTaskExecutor"