Skip to content

HumanEvaluationConfigDict

Dictionary Type

HumanEvaluationConfigDict

Bases: TypedDict

Dictionary form of HumanEvaluationConfig.

Attributes

custom_metrics instance-attribute

A HumanEvaluationCustomMetric object. It contains the names the metrics, how the metrics are to be evaluated, an optional description.

dataset_metric_configs instance-attribute

Use to specify the metrics, task, and prompt dataset to be used in your model evaluation job.

human_workflow_config instance-attribute
human_workflow_config: HumanWorkflowConfig | HumanWorkflowConfigDict | None

The parameters of the human workflow.