LlmAsAJudgeEvaluatorConfigDict¶
Dictionary Type¶
LlmAsAJudgeEvaluatorConfigDict
¶
Bases: TypedDict
Dictionary form of LlmAsAJudgeEvaluatorConfig.
Attributes¶
instructions
instance-attribute
¶
The evaluation instructions that guide the language model in assessing agent performance, including criteria and evaluation guidelines.
model_config
instance-attribute
¶
model_config: Required[EvaluatorModelConfig | EvaluatorModelConfigDict]
The model configuration that specifies which foundation model to use and how to configure it for evaluation.
rating_scale
instance-attribute
¶
rating_scale: Required[RatingScale | RatingScaleDict]
The rating scale that defines how the evaluator should score agent performance, either numerical or categorical.