EvalSummary

org.llm4s.rag.evaluation.EvalSummary
final case class EvalSummary(results: Seq[EvalResult], averages: Map[String, Double], overallRagasScore: Double, sampleCount: Int)

Summary of batch evaluation across multiple samples.

Value parameters

averages

Average score per metric across all samples

overallRagasScore

Average RAGAS score across all samples

results

Individual results for each sample

sampleCount

Number of samples evaluated

Attributes

Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def lowScoringForMetric(metricName: String, threshold: Double): Seq[EvalResult]

Get samples where a specific metric scored below a threshold.

Get samples where a specific metric scored below a threshold.

Attributes

def lowScoringSamples(threshold: Double): Seq[EvalResult]

Get samples that scored below a threshold.

Get samples that scored below a threshold.

Attributes

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product