ExperimentResult

org.llm4s.rag.benchmark.ExperimentResult
See theExperimentResult companion object
final case class ExperimentResult(config: RAGExperimentConfig, evalSummary: Option[EvalSummary], timings: Seq[TimingInfo], documentCount: Int, chunkCount: Int, queryCount: Int, metadata: Map[String, String], error: Option[String])

Result of a single experiment run.

Value parameters

chunkCount

Number of chunks created

config

The experiment configuration used

documentCount

Number of documents indexed

error

Optional error if experiment failed

evalSummary

RAGAS evaluation summary with all metric scores

metadata

Additional experiment metadata

queryCount

Number of queries evaluated

timings

Timing breakdown by phase

Attributes

Companion
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def answerRelevancy: Option[Double]

Answer relevancy score

Answer relevancy score

Attributes

def contextPrecision: Option[Double]

Context precision score

Context precision score

Attributes

def contextRecall: Option[Double]

Context recall score

Context recall score

Attributes

def evaluationTime: Option[TimingInfo]

RAGAS evaluation time

RAGAS evaluation time

Attributes

def faithfulness: Option[Double]

Faithfulness score

Faithfulness score

Attributes

def getTiming(phase: String): Option[TimingInfo]

Get timing for a specific phase

Get timing for a specific phase

Attributes

def indexingTime: Option[TimingInfo]

Indexing time

Indexing time

Attributes

def metricScore(name: String): Option[Double]

Get a specific metric average

Get a specific metric average

Attributes

def ragasScore: Double

Overall RAGAS score (0.0 if failed)

Overall RAGAS score (0.0 if failed)

Attributes

def searchTime: Option[TimingInfo]

Search/retrieval time

Search/retrieval time

Attributes

def success: Boolean

Whether this experiment succeeded

Whether this experiment succeeded

Attributes

def totalTimeMs: Long

Total time across all phases

Total time across all phases

Attributes

def totalTimeSeconds: Double

Total time in seconds

Total time in seconds

Attributes

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product