ExperimentComparison

org.llm4s.rag.benchmark.ExperimentComparison
final case class ExperimentComparison(baseline: ExperimentResult, comparison: ExperimentResult)

Comparison between two experiment results.

Value parameters

baseline

The baseline experiment

comparison

The experiment being compared

Attributes

Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def isImprovement: Boolean

Whether comparison is better than baseline

Whether comparison is better than baseline

Attributes

def metricDiffs: Map[String, Double]

Per-metric differences

Per-metric differences

Attributes

def ragasDiff: Double

RAGAS score difference (positive = comparison is better)

RAGAS score difference (positive = comparison is better)

Attributes

def relativeImprovement: Double

Relative improvement as percentage

Relative improvement as percentage

Attributes

def summary: String

Summary string

Summary string

Attributes

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product