Skip to content

ExternalSourcesGenerationConfiguration

Structure Class

ExternalSourcesGenerationConfiguration dataclass

Bases: _SerdeShape

Contains the generation configuration of the external source wrapper object.

Attributes

additional_model_request_fields class-attribute instance-attribute
additional_model_request_fields: dict[str, Document] | None = ...

Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.

guardrail_configuration class-attribute instance-attribute
guardrail_configuration: GuardrailConfiguration | None = ...

The configuration details for the guardrail.

inference_config class-attribute instance-attribute
inference_config: InferenceConfig | None = ...

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.

performance_config class-attribute instance-attribute
performance_config: PerformanceConfiguration | None = ...

The latency configuration for the model.

prompt_template class-attribute instance-attribute
prompt_template: PromptTemplate | None = ...

Contain the textPromptTemplate string for the external source wrapper object.