Ttl

org.llm4s.llmconnect.model.PromptCache.Ttl
enum Ttl

How long the provider keeps the cache.

Attributes

Source
PromptCache.scala
Graph
Supertypes
trait Enum
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Type members

Enum entries

case Long extends Ttl

The provider's long lifetime: 1 hour on Anthropic, at a higher write price.

The provider's long lifetime: 1 hour on Anthropic, at a higher write price.

Attributes

Source
PromptCache.scala
case Short extends Ttl

The provider's short lifetime: 5 minutes on Anthropic, refreshed on each read.

The provider's short lifetime: 5 minutes on Anthropic, refreshed on each read.

Attributes

Source
PromptCache.scala