OrchestrationConfigurationDict¶
Dictionary Type¶
OrchestrationConfigurationDict
¶
Bases: TypedDict
Dictionary form of OrchestrationConfiguration.
Attributes¶
additional_model_request_fields
instance-attribute
¶
Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.
inference_config
instance-attribute
¶
inference_config: InferenceConfig | InferenceConfigDict | None
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.
performance_config
instance-attribute
¶
performance_config: PerformanceConfiguration | PerformanceConfigurationDict | None
The latency configuration for the model.
prompt_template
instance-attribute
¶
prompt_template: PromptTemplate | PromptTemplateDict | None
Contains the template for the prompt that's sent to the model.
Orchestration prompts must include the $conversation_history$ and
$output_format_instructions$ variables. For more information, see Use
placeholder
variables
in the user guide.
query_transformation_configuration
instance-attribute
¶
query_transformation_configuration: QueryTransformationConfiguration | QueryTransformationConfigurationDict | None
To split up the prompt and retrieve multiple sources, set the
transformation type to QUERY_DECOMPOSITION.