Skip to content

LlmAsAJudgeEvaluatorConfigDict

Dictionary Type

LlmAsAJudgeEvaluatorConfigDict

Bases: TypedDict

Dictionary form of LlmAsAJudgeEvaluatorConfig.

Attributes

instructions instance-attribute
instructions: Required[str]

The evaluation instructions that guide the language model in assessing agent performance, including criteria and evaluation guidelines.

model_config instance-attribute

The model configuration that specifies which foundation model to use and how to configure it for evaluation.

rating_scale instance-attribute

The rating scale that defines how the evaluator should score agent performance, either numerical or categorical.