Skip to content

PerformanceConfiguration

Structure Class

PerformanceConfiguration dataclass

Bases: _SerdeShape

Contains performance settings for a model.

Attributes

latency class-attribute instance-attribute
latency: str | None = ...

Specifies whether to use the latency-optimized or standard version of a model or inference profile.