AsyncProperties

org.llm4s.spring.AsyncProperties

Sizing of the executor behind LLM4STemplate's completeAsync (llm4s.async.*).

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete fields

var maxThreads: Int

Maximum worker threads of the default llm4sTaskExecutor (idle threads time out).

Maximum worker threads of the default llm4sTaskExecutor (idle threads time out).

Attributes

var queueCapacity: Int

Pending completeAsync calls the default executor queues before rejecting new ones.

Pending completeAsync calls the default executor queues before rejecting new ones.

Attributes