SemanticChunker

org.llm4s.chunking.SemanticChunker
See theSemanticChunker companion class

Attributes

Companion
class
Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

def apply(embeddingClient: EmbeddingClient, modelConfig: EmbeddingModelConfig, similarityThreshold: Double, batchSize: Int): SemanticChunker

Create a new semantic chunker.

Create a new semantic chunker.

Value parameters

batchSize

Number of sentences to embed at once (default: 50)

embeddingClient

Client for generating embeddings

modelConfig

Model configuration for embeddings

similarityThreshold

Minimum similarity to stay in same chunk (default: 0.5)

Attributes

Concrete fields

Default batch size for embedding requests.

Default batch size for embedding requests.

Attributes

Default similarity threshold for topic detection.

Default similarity threshold for topic detection.

Attributes