ParallelWithLimit
org.llm4s.toolapi.ToolExecutionStrategy.ParallelWithLimit
final case class ParallelWithLimit(maxConcurrency: Int) extends ToolExecutionStrategy
Execute tools in parallel with a concurrency limit.
Balances parallel execution with resource constraints. Use it when external APIs have rate limits, the system has limited local resources, or parallel execution is useful but must remain controlled.
Value parameters
- maxConcurrency
-
Maximum number of tools executing simultaneously
Attributes
- Graph
-
- Supertypes
-
trait Serializabletrait Producttrait Equalstrait ToolExecutionStrategyclass Objecttrait Matchableclass Any
Members list
In this article