llm4s-docs/org.llm4s/org.llm4s.error/RateLimitOrigin

RateLimitOrigin

org.llm4s.error.RateLimitOrigin

Where a RateLimitError originated. Distinguishes a request that never left the process (rejected by a local token bucket) from one the provider itself rejected with an HTTP 429 - the two need different treatment when a caller has already recorded a metrics event for the local case, e.g. org.llm4s.llmconnect.middleware.RateLimitingMiddleware.

Attributes

Graph
Supertypes: trait Enum

trait Serializable

trait Product

trait Equals

class Object

trait Matchable

class Any
Show all

RateLimitOrigin

Attributes

Members list

Type members

Enum entries