GenerationConfigurationDict¶
Dictionary Type¶
GenerationConfigurationDict
¶
Bases: TypedDict
Dictionary form of GenerationConfiguration.
Attributes¶
additional_model_request_fields
instance-attribute
¶
Additional model parameters and corresponding values not included in the
textInferenceConfig structure for a knowledge base. This allows you to
provide custom model parameters specific to the language model being
used.
guardrail_configuration
instance-attribute
¶
guardrail_configuration: GuardrailConfiguration | GuardrailConfigurationDict | None
Contains configuration details for the guardrail.
kb_inference_config
instance-attribute
¶
kb_inference_config: KbInferenceConfig | KbInferenceConfigDict | None
Contains configuration details for inference for knowledge base retrieval and response generation.
prompt_template
instance-attribute
¶
prompt_template: PromptTemplate | PromptTemplateDict | None
Contains the template for the prompt that's sent to the model for response generation.