InferenceConfigDict¶
Dictionary Type¶
InferenceConfigDict
¶
Bases: TypedDict
Dictionary form of InferenceConfig.
Attributes¶
text_inference_config
instance-attribute
¶
text_inference_config: TextInferenceConfig | TextInferenceConfigDict | None
Configuration settings specific to text generation while generating responses using RetrieveAndGenerate.