llm4s-core/org.llm4s/org.llm4s.llmconnect/org.llm4s.llmconnect.middleware/LLMMiddleware

LLMMiddleware

org.llm4s.llmconnect.middleware.LLMMiddleware

A middleware that wraps an LLMClient to add cross-cutting behavior.

Middleware instances are composable and applied in order via LLMClientPipeline. The last middleware added is the outermost wrapper (first to execute).

Attributes

Graph
Supertypes: class Object

trait Matchable

class Any
Known subtypes: class CachingMiddleware

class InputSanitizationMiddleware

class LoggingMiddleware

class MetricsMiddleware

class RateLimitingMiddleware

class RequestIdMiddleware
Show all

Members list

Value members

Abstract methods

Human-readable name for logging/debugging.

Attributes

Wrap the given LLMClient, returning a new client with added behavior.

Implementations should delegate all LLMClient methods to next, adding behavior before/after delegation as needed.

Value parameters

next: the next client in the pipeline

Attributes

Returns: a new LLMClient with this middleware's behavior added

In this article

Generated with