AsyncProperties

org.llm4s.spring.AsyncProperties

Sizing of the executor behind LLM4STemplate's completeAsync (llm4s.async.*).

Attributes

Source
Llm4sProperties.scala
Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete fields

Maximum worker threads of the default llm4sTaskExecutor (idle threads time out).

Maximum worker threads of the default llm4sTaskExecutor (idle threads time out).

Attributes

Source
Llm4sProperties.scala

Pending completeAsync calls the default executor queues before rejecting new ones.

Pending completeAsync calls the default executor queues before rejecting new ones.

Attributes

Source
Llm4sProperties.scala