Skip to content

EvaluatorSummary

Structure Class

EvaluatorSummary dataclass

Bases: _SerdeShape

Summary statistics for a single evaluator within a batch evaluation.

Attributes

evaluation_dimension_name class-attribute instance-attribute
evaluation_dimension_name: str | None = ...

The name of the dimension that this summary covers. This field is set only for evaluators that use a multi-dimensional rating scale, where each dimension is summarized separately. For single-scale evaluators, this field is not set.

evaluator_id class-attribute instance-attribute
evaluator_id: str | None = ...

The unique identifier of the evaluator.

statistics class-attribute instance-attribute
statistics: EvaluatorStatistics | None = ...

The aggregated statistics for this evaluator.

total_evaluated class-attribute instance-attribute
total_evaluated: int | None = ...

The total number of sessions evaluated by this evaluator.

total_failed class-attribute instance-attribute
total_failed: int | None = ...

The total number of sessions that failed evaluation by this evaluator.