Skip to content

InferenceOperationConfigurationDict

Dictionary Type

InferenceOperationConfigurationDict

Bases: TypedDict

Dictionary form of InferenceOperationConfiguration.

Attributes

models instance-attribute

The list of models supported for this operation.

path instance-attribute
path: Required[str]

The request path for this operation (for example, /v1/messages or /v1/responses).

provider_path instance-attribute
provider_path: str | None

The provider path to forward requests to, if it differs from the request path. For example, /anthropic/v1/messages when the provider expects a different path than the client-facing /v1/messages.