Skip to content

EvaluationDatasetDict

Dictionary Type

EvaluationDatasetDict

Bases: TypedDict

Dictionary form of EvaluationDataset.

Attributes

dataset_location instance-attribute

For custom prompt datasets, you must specify the location in Amazon S3 where the prompt dataset is saved.

name instance-attribute
name: Required[str]

Used to specify supported built-in prompt datasets. Valid values are Builtin.Bold, Builtin.BoolQ, Builtin.NaturalQuestions, Builtin.Gigaword, Builtin.RealToxicityPrompts, Builtin.TriviaQA, Builtin.T-Rex, Builtin.WomensEcommerceClothingReviews and Builtin.Wikitext2.