PromptCaching

org.llm4s.capability.PromptCaching
@Experimental
sealed trait PromptCaching

The provider caches the prompt for this model (ModelMetadata.supports("prompt_caching")).

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
In this article