Llm4sJlamaModule

org.llm4s.llmconnect.provider.Llm4sJlamaModule
@Experimental

Registers llm4s-jlama's provider: a model run in-process by Jlama, under the id jlama.

Declared in this module's META-INF/services/org.llm4s.llmconnect.spi.Llm4sProviderModule, so adding the llm4s-jlama dependency is all it takes for ProviderRegistry.default to resolve provider = "jlama". Where discovery cannot run - a fat jar whose services files were overwritten rather than merged - register it explicitly:

given ProviderRegistry = ProviderRegistry.ofModules(new Llm4sJlamaModule)

A class rather than an object because java.util.ServiceLoader instantiates the class named in the services file through its public no-arg constructor.

Attributes

Source
Llm4sJlamaModule.scala
Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

The chat providers this module supplies.

The chat providers this module supplies.

Attributes

Definition Classes
Source
Llm4sJlamaModule.scala

Inherited methods

The embedding providers this module supplies.

The embedding providers this module supplies.

Both lists default to empty, so a module contributes whichever halves it has: llm4s-anthropic overrides only chatProviders, a Voyage or Jina module only embeddingProviders, and llm4s-ollama both.

Attributes

Inherited from:
Llm4sProviderModule
Source
Llm4sProviderModule.scala