InferenceConfig¶
Structure Class¶
InferenceConfig
dataclass
¶
Bases: _SerdeShape
The configuration for inference settings when generating responses using RetrieveAndGenerate.
Attributes¶
text_inference_config
class-attribute
instance-attribute
¶
text_inference_config: TextInferenceConfig | None = ...
Configuration settings specific to text generation while generating responses using RetrieveAndGenerate.