Llm4sWatsonXModule

org.llm4s.llmconnect.provider.Llm4sWatsonXModule

Registers llm4s-watsonx's provider: the IBM watsonx.ai chat client, under the id watsonx.

'''Beta - never run against the live service.''' The client calls the watsonx.ai chat API (/ml/v1/text/chat and /ml/v1/text/chat_stream), with tool calling; its request and response shapes are cross-checked against IBM's own open-source clients but have not been checked against a real account (https://github.com/llm4s/llm4s/issues/1314). The module's API is not frozen.

Declared in this module's META-INF/services/org.llm4s.llmconnect.spi.Llm4sProviderModule, so adding the llm4s-watsonx dependency is all it takes for ProviderRegistry.default to resolve provider = "watsonx". Where discovery cannot run - a fat jar whose services files were overwritten rather than merged - register it explicitly:

given ProviderRegistry = ProviderRegistry.ofModules(new Llm4sWatsonXModule)

A class rather than an object because java.util.ServiceLoader instantiates the class named in the services file through its public no-arg constructor.

Attributes

Source
Llm4sWatsonXModule.scala
Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

The chat providers this module supplies.

The chat providers this module supplies.

Attributes

Definition Classes
Source
Llm4sWatsonXModule.scala

Inherited methods

The embedding providers this module supplies.

The embedding providers this module supplies.

Both lists default to empty, so a module contributes whichever halves it has: llm4s-anthropic overrides only chatProviders, a Voyage or Jina module only embeddingProviders, and llm4s-ollama both.

Attributes

Inherited from:
Llm4sProviderModule
Source
Llm4sProviderModule.scala