llm4s-docs
API
Generated with
llm4s-docs/org.llm4s/org.llm4s.reliability/RateLimitConfig

RateLimitConfig

org.llm4s.reliability.RateLimitConfig
See theRateLimitConfig companion object
final case class RateLimitConfig(enabled: Boolean, requestsPerMinute: Int, burstCapacity: Int)

Local token-bucket rate limiting configuration.

Value parameters

burstCapacity

Maximum tokens the bucket can hold, i.e. the largest burst allowed

enabled

Whether local rate limiting is applied

requestsPerMinute

Sustained request rate once the bucket is empty

Attributes

Companion
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def withBurstCapacity(burst: Int): RateLimitConfig

Set burst capacity

Set burst capacity

Attributes

def withEnabled(isEnabled: Boolean): RateLimitConfig

Set enabled flag

Set enabled flag

Attributes

def withRequestsPerMinute(rpm: Int): RateLimitConfig

Set requests per minute

Set requests per minute

Attributes

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product
Generated with