ModelPerformanceConfiguration¶
Structure Class¶
ModelPerformanceConfiguration
dataclass
¶
Bases: _SerdeShape
The performance configuration for a model called with InvokeFlow.
Attributes¶
performance_config
class-attribute
instance-attribute
¶
performance_config: PerformanceConfiguration | None = ...
The latency configuration for the model.