Skip to content

InferenceTargetConfigurationDict

Union Type

InferenceTargetConfigurationDict module-attribute

Dictionary form of InferenceTargetConfiguration, setting exactly one variant.

Union Member Types

InferenceTargetConfigurationConnectorDict

Bases: TypedDict

Attributes

connector instance-attribute

The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.

InferenceTargetConfigurationProviderDict

Bases: TypedDict

Attributes

provider instance-attribute

The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.