ContextWindowResolver

org.llm4s.llmconnect.config.ContextWindowResolver

Centralized resolver for model context window and reserve completion tokens.

Replaces duplicated getContextWindowForModel logic across provider configs. Performs registry lookup, then applies provider-specific fallbacks when not found.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

def resolve(lookupProviders: Seq[String], modelName: String, defaultContextWindow: Int, defaultReserve: Int, fallbackResolver: String => (Int, Int), logPrefix: String): (Int, Int)

Resolve (contextWindow, reserveCompletion) for a model.

Resolve (contextWindow, reserveCompletion) for a model.

Value parameters

defaultContextWindow

Default when registry hit but maxInputTokens missing

defaultReserve

Default when registry hit but maxOutputTokens missing

fallbackResolver

Function to compute fallback when registry miss

logPrefix

Optional prefix for debug log (e.g., "Azure " for Azure provider)

lookupProviders

Providers to try in order (e.g., Seq("azure", "openai") for Azure)

modelName

Model identifier

Attributes

Returns

(contextWindow, reserveCompletion)