Skip to content

ExternalSourcesGenerationConfigurationDict

Dictionary Type

ExternalSourcesGenerationConfigurationDict

Bases: TypedDict

Dictionary form of ExternalSourcesGenerationConfiguration.

Attributes

additional_model_request_fields instance-attribute
additional_model_request_fields: Mapping[str, Document] | None

Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.

guardrail_configuration instance-attribute
guardrail_configuration: GuardrailConfiguration | GuardrailConfigurationDict | None

The configuration details for the guardrail.

inference_config instance-attribute
inference_config: InferenceConfig | InferenceConfigDict | None

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.

performance_config instance-attribute

The latency configuration for the model.

prompt_template instance-attribute
prompt_template: PromptTemplate | PromptTemplateDict | None

Contain the textPromptTemplate string for the external source wrapper object.