OpenAICompatibleModelLister

org.llm4s.config.OpenAICompatibleModelLister

Model lister for the generic openai-compatible provider: GET <baseUrl>/models.

The section's baseUrl is required - there is no default endpoint - and its apiKey is optional, as it is for chat: a local server such as vLLM, LM Studio or llama.cpp lists its models without one. The section's headers are sent too.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

Fetches the list of available models for the given provider configuration.

Fetches the list of available models for the given provider configuration.

Value parameters

config

the validated named provider configuration containing credentials and base URL

httpClient

the HTTP client to use for API requests

Attributes

Returns

Right with the list of discovered models, or Left with an error