Skip to content

AutomatedEvaluationCustomMetricConfig

Structure Class

AutomatedEvaluationCustomMetricConfig dataclass

Bases: _SerdeShape

Defines the configuration of custom metrics to be used in an evaluation job. To learn more about using custom metrics in Amazon Bedrock evaluation jobs, see Create a prompt for a custom metrics (LLM-as-a-judge model evaluations) and Create a prompt for a custom metrics (RAG evaluations).

Attributes

custom_metrics instance-attribute

Defines a list of custom metrics to be used in an Amazon Bedrock evaluation job.

evaluator_model_config instance-attribute
evaluator_model_config: CustomMetricEvaluatorModelConfig

Configuration of the evaluator model you want to use to evaluate custom metrics in an Amazon Bedrock evaluation job.