Skip to content

ModelPerformanceConfiguration

Structure Class

ModelPerformanceConfiguration dataclass

Bases: _SerdeShape

The performance configuration for a model called with InvokeFlow.

Attributes

performance_config class-attribute instance-attribute
performance_config: PerformanceConfiguration | None = ...

The latency configuration for the model.