Skip to content

EvaluatorReference

Union Type

EvaluatorReference module-attribute

The reference to an evaluator used in online evaluation configurations, containing the evaluator identifier.

Union Member Types

EvaluatorReferenceEvaluatorId dataclass

Bases: _SerdeShape

The unique identifier of the evaluator. Can reference builtin evaluators (e.g., Builtin.Helpfulness) or custom evaluators.

Attributes

value instance-attribute
value: str

EvaluatorReferenceUnknown dataclass

Bases: _SerdeShape

Represents an unknown variant. If you receive this value, you will need to update your library to receive the parsed value. This value may not be deliberately sent.

Attributes

tag instance-attribute
tag: str