Skip to content

Evaluator

Structure Class

Evaluator dataclass

Bases: _SerdeShape

An evaluator to run against sessions during batch evaluation.

Attributes

evaluator_id instance-attribute
evaluator_id: str

The unique identifier of the evaluator. Can reference built-in evaluators (e.g., Builtin.Helpfulness) or custom evaluators.