EvaluationDatasetDict¶
Dictionary Type¶
EvaluationDatasetDict
¶
Bases: TypedDict
Dictionary form of EvaluationDataset.
Attributes¶
dataset_location
instance-attribute
¶
dataset_location: EvaluationDatasetLocation | EvaluationDatasetLocationDict | None
For custom prompt datasets, you must specify the location in Amazon S3 where the prompt dataset is saved.
name
instance-attribute
¶
Used to specify supported built-in prompt datasets. Valid values are
Builtin.Bold, Builtin.BoolQ, Builtin.NaturalQuestions,
Builtin.Gigaword, Builtin.RealToxicityPrompts, Builtin.TriviaQA,
Builtin.T-Rex, Builtin.WomensEcommerceClothingReviews and
Builtin.Wikitext2.