ExternalSourcesGenerationConfigurationDict¶
Dictionary Type¶
ExternalSourcesGenerationConfigurationDict
¶
Bases: TypedDict
Dictionary form of ExternalSourcesGenerationConfiguration.
Attributes¶
additional_model_request_fields
instance-attribute
¶
Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.
guardrail_configuration
instance-attribute
¶
guardrail_configuration: GuardrailConfiguration | GuardrailConfigurationDict | None
The configuration details for the guardrail.
inference_config
instance-attribute
¶
inference_config: InferenceConfig | InferenceConfigDict | None
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.
performance_config
instance-attribute
¶
performance_config: PerformanceConfiguration | PerformanceConfigurationDict | None
The latency configuration for the model.
prompt_template
instance-attribute
¶
prompt_template: PromptTemplate | PromptTemplateDict | None
Contain the textPromptTemplate string for the external source wrapper object.