Skip to content

EvaluationInferenceConfigDict

Union Type

EvaluationInferenceConfigDict module-attribute

Dictionary form of EvaluationInferenceConfig, setting exactly one variant.

Union Member Types

EvaluationInferenceConfigModelsDict

Bases: TypedDict

Attributes

models instance-attribute

Specifies the inference models.

EvaluationInferenceConfigRagConfigsDict

Bases: TypedDict

Attributes

rag_configs instance-attribute

Contains the configuration details of the inference for a knowledge base evaluation job, including either the retrieval only configuration or the retrieval with response generation configuration.