Skip to content

RatingScale

Union Type

RatingScale module-attribute

The rating scale that defines how evaluators should score agent performance, supporting both numerical and categorical scales.

Union Member Types

RatingScaleNumerical dataclass

Bases: _SerdeShape

The numerical rating scale with defined score values and descriptions for quantitative evaluation.

Attributes

value instance-attribute

RatingScaleCategorical dataclass

Bases: _SerdeShape

The categorical rating scale with named categories and definitions for qualitative evaluation.

Attributes

value instance-attribute

RatingScaleMultiDimensional dataclass

Bases: _SerdeShape

A list of dimensions that lets an LLM-as-a-judge evaluator score several dimensions of the same target in a single evaluation. Each dimension has its own instruction and rating scale, and produces its own result.

Attributes

value instance-attribute

RatingScaleUnknown dataclass

Bases: _SerdeShape

Represents an unknown variant. If you receive this value, you will need to update your library to receive the parsed value. This value may not be deliberately sent.

Attributes

tag instance-attribute
tag: str