Skip to content

PerformanceConfiguration

Structure Class

PerformanceConfiguration dataclass

Bases: _SerdeShape

Performance settings for a model.

Attributes

latency class-attribute instance-attribute
latency: str = ...

To use a latency-optimized version of the model, set to optimized.