Example

org.llm4s.eval.dataset.Example
final case class Example[I, O](id: ExampleId, input: I, referenceOutput: Option[O], tags: Set[String], metadata: Map[String, String])

A single labelled example in a dataset.

Type parameters

I

input type

O

output type

Value parameters

id

unique identifier for this example

input

the model input (generic; often ujson.Value)

metadata

arbitrary string key-value annotations

referenceOutput

optional ground-truth output to compare model responses against

tags

free-form labels for filtering (e.g. "qa", "rag")

Attributes

Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product