PromptCache

org.llm4s.llmconnect.model.PromptCache
See thePromptCache companion class
object PromptCache

Attributes

Companion
class
Source
PromptCache.scala
Graph
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type

Members list

Type members

Classlikes

enum Scope

A part of the request to cache.

A part of the request to cache.

Attributes

Source
PromptCache.scala
Supertypes
trait Enum
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all
enum Ttl

How long the provider keeps the cache.

How long the provider keeps the cache.

Attributes

Source
PromptCache.scala
Supertypes
trait Enum
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Inherited and Abstract types

The names of the product elements

The names of the product elements

Attributes

Inherited from:
Mirror
Source
Mirror.scala

The name of the type

The name of the type

Attributes

Inherited from:
Mirror
Source
Mirror.scala

Value members

Concrete methods

def apply(scope: Set[Scope], ttl: Ttl): PromptCache

Creates a PromptCache.

Creates a PromptCache.

Attributes

Source
PromptCache.scala

Concrete fields

The system prompt and the tools, for the short lifetime: what most repeated requests share.

The system prompt and the tools, for the short lifetime: what most repeated requests share.

Attributes

Source
PromptCache.scala