InferenceOperationConfigurationDict¶
Dictionary Type¶
InferenceOperationConfigurationDict
¶
Bases: TypedDict
Dictionary form of InferenceOperationConfiguration.
Attributes¶
models
instance-attribute
¶
models: Sequence[ModelEntry | ModelEntryDict] | None
The list of models supported for this operation.
path
instance-attribute
¶
The request path for this operation (for example, /v1/messages or
/v1/responses).