llm4s-core
API
Generated with
llm4s-core/org.llm4s/org.llm4s.llmconnect/org.llm4s.llmconnect.caching/InMemoryEmbeddingCache

InMemoryEmbeddingCache

org.llm4s.llmconnect.caching.InMemoryEmbeddingCache
class InMemoryEmbeddingCache[Embedding](maxSize: Int, ttl: Option[FiniteDuration], clock: () => Long) extends EmbeddingCache[Embedding]

Thread-safe in-memory implementation of EmbeddingCache with LRU eviction.

Type parameters

Embedding

The embedding type (usually Seq[Double]).

Value parameters

maxSize

The maximum number of embeddings to store before evicting the oldest.

ttl

Optional Time-To-Live for cache entries. Expired entries are lazily evicted on access.

Attributes

Graph
Supertypes
trait EmbeddingCache[Embedding]
class Object
trait Matchable
class Any

Members list

Value members

Constructors

def this(maxSize: Int, ttl: Option[FiniteDuration])

Binary-compatible auxiliary constructor matching the pre-clock 2-param signature.

Binary-compatible auxiliary constructor matching the pre-clock 2-param signature.

Attributes

Concrete methods

override def clear(): Unit

Clears all cached entries and resets statistics.

Clears all cached entries and resets statistics.

Attributes

Definition Classes
def get(key: String): Option[Embedding]

Retrieves an embedding and updates hit/miss counters.

Retrieves an embedding and updates hit/miss counters.

Attributes

def put(key: String, embedding: Embedding): Unit

Stores an embedding, potentially triggering LRU eviction.

Stores an embedding, potentially triggering LRU eviction.

Attributes

override def stats(): CacheStats

Returns type-safe cache statistics.

Returns type-safe cache statistics.

Attributes

Definition Classes
Generated with