Skip to content

HumanEvaluationCustomMetricDict

Dictionary Type

HumanEvaluationCustomMetricDict

Bases: TypedDict

Dictionary form of HumanEvaluationCustomMetric.

Attributes

description instance-attribute
description: str | None

An optional description of the metric. Use this parameter to provide more details about the metric.

name instance-attribute
name: Required[str]

The name of the metric. Your human evaluators will see this name in the evaluation UI.

rating_method instance-attribute
rating_method: Required[str]

Choose how you want your human workers to evaluation your model. Valid values for rating methods are ThumbsUpDown, IndividualLikertScale,ComparisonLikertScale, ComparisonChoice, and ComparisonRank