HumanEvaluationConfigDict¶
Dictionary Type¶
HumanEvaluationConfigDict
¶
Bases: TypedDict
Dictionary form of HumanEvaluationConfig.
Attributes¶
custom_metrics
instance-attribute
¶
custom_metrics: Sequence[HumanEvaluationCustomMetric | HumanEvaluationCustomMetricDict] | None
A HumanEvaluationCustomMetric object. It contains the names the
metrics, how the metrics are to be evaluated, an optional description.
dataset_metric_configs
instance-attribute
¶
dataset_metric_configs: Required[Sequence[EvaluationDatasetMetricConfig | EvaluationDatasetMetricConfigDict]]
Use to specify the metrics, task, and prompt dataset to be used in your model evaluation job.
human_workflow_config
instance-attribute
¶
human_workflow_config: HumanWorkflowConfig | HumanWorkflowConfigDict | None
The parameters of the human workflow.