Skip to content

OrchestrationConfigurationDict

Dictionary Type

OrchestrationConfigurationDict

Bases: TypedDict

Dictionary form of OrchestrationConfiguration.

Attributes

additional_model_request_fields instance-attribute
additional_model_request_fields: Mapping[str, Document] | None

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.

inference_config instance-attribute
inference_config: InferenceConfig | InferenceConfigDict | None

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.

performance_config instance-attribute

The latency configuration for the model.

prompt_template instance-attribute
prompt_template: PromptTemplate | PromptTemplateDict | None

Contains the template for the prompt that's sent to the model. Orchestration prompts must include the $conversation_history$ and $output_format_instructions$ variables. For more information, see Use placeholder variables in the user guide.

query_transformation_configuration instance-attribute
query_transformation_configuration: QueryTransformationConfiguration | QueryTransformationConfigurationDict | None

To split up the prompt and retrieve multiple sources, set the transformation type to QUERY_DECOMPOSITION.