Skip to content

InferenceConfig

Structure Class

InferenceConfig dataclass

Bases: _SerdeShape

The configuration for inference settings when generating responses using RetrieveAndGenerate.

Attributes

text_inference_config class-attribute instance-attribute
text_inference_config: TextInferenceConfig | None = ...

Configuration settings specific to text generation while generating responses using RetrieveAndGenerate.