Skip to content

PerformanceConfigurationDict

Dictionary Type

PerformanceConfigurationDict

Bases: TypedDict

Dictionary form of PerformanceConfiguration.

Attributes

latency instance-attribute
latency: str | None

Specifies whether to use the latency-optimized or standard version of a model or inference profile.