ContextWindowMiddleware
Prunes the messages each model call is sent to config, leaving the stored history whole. The system prompt, which reaches the model call first, is kept out of pruning and stays first; it is not counted against maxMessages or maxTokens. A tool call is never sent without its results, nor a result without its call; the current turn (from the latest user message) is never pruned - the strategy runs on the history before it, with the budget the turn leaves - and the pruned history starts with a user message, so a send may exceed the budget when the current turn alone is larger.
Attributes
- Graph
-
- Supertypes
Members list
Value members
Concrete methods
Wraps one model call. A wrapper may rewrite the request (inject a note, filter tools), call next more than once (retry, fallback), transform its result, or return Left, which fails the run. A model wrapper cannot suspend.
Wraps one model call. A wrapper may rewrite the request (inject a note, filter tools), call next more than once (retry, fallback), transform its result, or return Left, which fails the run. A model wrapper cannot suspend.
Filtering ModelRequest.tools shapes what the model is offered and is not a permission control: a tool the model calls anyway still runs through wrapToolCall, where denial belongs.
Attributes
- Definition Classes
Inherited methods
Sees the run's final answer: returns it, possibly changed, or Left to fail the run.
Sees the run's final answer: returns it, possibly changed, or Left to fail the run.
Attributes
- Inherited from:
- AgentMiddleware
Sees the run's input before anything else runs: returns it, possibly changed, or Left to fail the run.
Sees the run's input before anything else runs: returns it, possibly changed, or Left to fail the run.
Attributes
- Inherited from:
- AgentMiddleware
Middleware this one must run inside of (be wrapped by); each must be registered in the same stack.
Middleware this one must run inside of (be wrapped by); each must be registered in the same stack.
Attributes
- Inherited from:
- AgentMiddleware
Middleware this one must run outside of (wrap); each must be registered in the same stack.
Middleware this one must run outside of (wrap); each must be registered in the same stack.
Attributes
- Inherited from:
- AgentMiddleware
Tools this middleware contributes; they join the loop's tool set and are validated like any other.
Tools this middleware contributes; they join the loop's tool set and are validated like any other.
Attributes
- Inherited from:
- AgentMiddleware
Wraps one tool call, after its arguments were validated. A wrapper denies with ToolOutcome.Error("Denied: ..."), asks for approval with NeedsApproval(reason) (unless context.approved), fails the run with Fatal, and short-circuits by not calling next. It may call next more than once (retry) and transform the outcome next returns.
Wraps one tool call, after its arguments were validated. A wrapper denies with ToolOutcome.Error("Denied: ..."), asks for approval with NeedsApproval(reason) (unless context.approved), fails the run with Fatal, and short-circuits by not calling next. It may call next more than once (retry) and transform the outcome next returns.
Attributes
- Inherited from:
- AgentMiddleware
The state keys this middleware's wrapToolCall may add to a Success update.
The state keys this middleware's wrapToolCall may add to a Success update.
Attributes
- Inherited from:
- AgentMiddleware
Concrete fields
This middleware's identifier, unique in its stack; must match [a-zA-Z0-9_-]{1,64}.
This middleware's identifier, unique in its stack; must match [a-zA-Z0-9_-]{1,64}.