org.llm4s.llmconnect.streaming
Members list
Type members
Classlikes
Snapshot of accumulator state
Snapshot of accumulator state
Attributes
- Supertypes
-
trait Serializabletrait Producttrait Equalsclass Objecttrait Matchableclass AnyShow all
Anthropic-specific streaming response handler
Anthropic-specific streaming response handler
Attributes
- Supertypes
Base implementation of StreamingResponseHandler with common functionality
Base implementation of StreamingResponseHandler with common functionality
Attributes
- Supertypes
- Known subtypes
-
class OpenAIStreamingHandler
OpenAI-specific streaming response handler
OpenAI-specific streaming response handler
Attributes
- Supertypes
Server-Sent Events (SSE) parser for streaming LLM responses.
Server-Sent Events (SSE) parser for streaming LLM responses.
Handles the SSE format used by both OpenAI and Anthropic streaming endpoints. SSE format consists of fields like:
- data:
- event:
- id:
- retry:
- :
Attributes
- Supertypes
-
class Objecttrait Matchableclass Any
- Self type
-
SSEParser.type
Accumulates streaming chunks into a complete response. Handles content accumulation, tool call accumulation, thinking content, and token tracking.
Accumulates streaming chunks into a complete response. Handles content accumulation, tool call accumulation, thinking content, and token tracking.
Attributes
- Companion
- object
- Supertypes
-
class Objecttrait Matchableclass Any
Factory for creating accumulators
Factory for creating accumulators
Attributes
- Companion
- class
- Supertypes
-
class Objecttrait Matchableclass Any
- Self type
-
StreamingAccumulator.type
Options for streaming completions with callbacks for different events. Provides a more flexible alternative to the simple onChunk callback.
Options for streaming completions with callbacks for different events. Provides a more flexible alternative to the simple onChunk callback.
Attributes
- Companion
- object
- Supertypes
-
trait Serializabletrait Producttrait Equalsclass Objecttrait Matchableclass AnyShow all
Companion object with convenience constructors
Companion object with convenience constructors
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
StreamingOptions.type
Handles streaming responses from LLM providers. Manages the lifecycle of streaming, chunk accumulation, and error handling.
Handles streaming responses from LLM providers. Manages the lifecycle of streaming, chunk accumulation, and error handling.
Attributes
- Companion
- object
- Supertypes
-
class Objecttrait Matchableclass Any
- Known subtypes
Factory for creating provider-specific handlers
Factory for creating provider-specific handlers
Attributes
- Companion
- trait
- Supertypes
-
class Objecttrait Matchableclass Any
- Self type