JlamaConfig

org.llm4s.llmconnect.config.JlamaConfig
See theJlamaConfig companion class
@Experimental
object JlamaConfig

Attributes

Companion
class
Source
JlamaConfig.scala
Graph
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type

Members list

Type members

Inherited and Abstract types

The names of the product elements

The names of the product elements

Attributes

Inherited from:
Mirror
Source
Mirror.scala

The name of the type

The name of the type

Attributes

Inherited from:
Mirror
Source
Mirror.scala

Value members

Concrete methods

~/.cache/llm4s/jlama: where models go when a section sets no modelDir.

~/.cache/llm4s/jlama: where models go when a section sets no modelDir.

Attributes

Source
JlamaConfig.scala
def fromValues(model: String, modelDir: Path, threads: Option[Int]): Result[JlamaConfig]

Builds a JlamaConfig. The model is trimmed and must be a Hugging Face id, owner/name; threads, when given, must be positive. Anything else is a ConfigurationError.

Builds a JlamaConfig. The model is trimmed and must be a Hugging Face id, owner/name; threads, when given, must be positive. Anything else is a ConfigurationError.

Attributes

Source
JlamaConfig.scala

Concrete fields

The context window assumed for every model: Jlama's KV cache grows with it, so it is kept small.

The context window assumed for every model: Jlama's KV cache grows with it, so it is kept small.

Attributes

Source
JlamaConfig.scala

The reply's length when a request sets no maxTokens.

The reply's length when a request sets no maxTokens.

Attributes

Source
JlamaConfig.scala