Skip to content

GenerationConfiguration

Structure Class

GenerationConfiguration dataclass

Bases: _SerdeShape

The configuration details for response generation based on retrieved text chunks.

Attributes

additional_model_request_fields class-attribute instance-attribute
additional_model_request_fields: dict[str, Document] | None = ...

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.

guardrail_configuration class-attribute instance-attribute
guardrail_configuration: GuardrailConfiguration | None = ...

Contains configuration details for the guardrail.

kb_inference_config class-attribute instance-attribute
kb_inference_config: KbInferenceConfig | None = ...

Contains configuration details for inference for knowledge base retrieval and response generation.

prompt_template class-attribute instance-attribute
prompt_template: PromptTemplate | None = ...

Contains the template for the prompt that's sent to the model for response generation.