CacheStats
org.llm4s.llmconnect.caching.CacheStats
case class CacheStats(size: Int, hits: Long, misses: Long, totalRequests: Long, hitRatePercent: Double)
Value parameters
- hitRatePercent
-
Percentage of requests served from cache (0.0 to 100.0).
- hits
-
Total number of successful cache lookups.
- misses
-
Total number of lookups that required a new embedding.
- size
-
Current number of entries in the cache.
- totalRequests
-
Combined sum of hits and misses.
Attributes
- Graph
-
- Supertypes
-
trait Serializabletrait Producttrait Equalsclass Objecttrait Matchableclass Any
Members list
In this article