Llm4sExecutors

org.llm4s.spring.Llm4sExecutors

Name of the executor bean behind completeAsync and the health probe; define a bean of this name to replace it.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

def create(p: AsyncProperties): ExecutorService

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads.

A bounded pool of daemon threads named llm4s-async-N: at most maxThreads workers (idle ones time out, so an idle application holds none) and queueCapacity queued calls; beyond that submit is rejected and completeAsync fails its future instead of growing without bound. Bounded rather than virtual threads.

Attributes

Concrete fields

final val BeanName: "llm4sTaskExecutor"