PruningStrategy

Adaptive windowing strategy that automatically determines the best context window size based on the model's context size and pricing information.

This strategy optimizes for cost-quality balance:

Uses tier-appropriate percentage of model's context window (reserves space for outputs)
Adjusts ratio based on model size (larger models use larger windows)
Preserves minimum recent turns for conversation coherence
Can optionally use cost-sensitive tuning

Model tiers and window ratios:

Value parameters

contextWindowSize: The model's actual context window in tokens
costSensitivity: How aggressively to optimize for cost (0.0-1.0, default: 0.5) 0.0 = maximize quality, 1.0 = minimize cost
inputCostPerToken: Optional cost per input token (enables cost optimization)
outputCostPerToken: Optional cost per output token
preserveMinTurns: Minimum number of recent turns to always preserve (default: 3)

Supertypes: trait Serializable

trait Product

trait Equals

trait PruningStrategy

class Object

trait Matchable

class Any
Show all

Custom pruning function. Receives all messages and returns the subset to keep. The function should be pure (no side effects) and deterministic.

Supertypes: trait Serializable

trait Product

trait Equals

trait PruningStrategy

class Object

trait Matchable

class Any
Show all

Remove messages from the middle, keeping start and end. Useful for preserving both initial context and recent exchanges.

Supertypes: trait Singleton

trait Product

trait Mirror

trait Serializable

trait Product

trait Equals

trait PruningStrategy

class Object

trait Matchable

class Any
Show all
Self type: MiddleOut.type

Remove oldest messages first (FIFO). Preserves system message (if configured) and most recent messages.

Supertypes: trait Singleton

trait Product

trait Mirror

trait Serializable

trait Product

trait Equals

trait PruningStrategy

class Object

trait Matchable

class Any
Show all
Self type: OldestFirst.type

Keep only the most recent N complete turns (user+assistant pairs). Drops everything older than the specified number of turns.

Supertypes: trait Serializable

trait Product

trait Equals

trait PruningStrategy

class Object

trait Matchable

class Any
Show all