org.llm4s.context.tokens.TokenizerAccuracy
See theTokenizerAccuracy companion object
Represents the accuracy of tokenizer mapping for a model.
This sealed trait hierarchy captures three levels of accuracy:
- '''Exact''': Native tokenizer available, counts are precise
- '''Approximate''': Using a similar tokenizer, counts may differ
- '''Unknown''': Unknown model, using fallback tokenizer
Attributes
- See also
- Companion
- object
- Graph
-
- Supertypes
-
class Objecttrait Matchableclass Any
- Known subtypes
Members list
In this article