Skip to content

ModelConfigurationDict

Dictionary Type

ModelConfigurationDict

Bases: TypedDict

Dictionary form of ModelConfiguration.

Attributes

additional_model_request_fields instance-attribute
additional_model_request_fields: Mapping[str, Document] | None

Additional model request fields. Use this to pass model-specific parameters that are not included in the standard inference configuration.

inference_config instance-attribute

The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.

model_id instance-attribute
model_id: Required[str]

The model to use for optimization. The value depends on the resource that you use:

  • If you use a base model, specify the model ID or its ARN. For a list of model IDs, see Models at a glance in the Amazon Bedrock User Guide.

  • If you use a cross-Region (system-defined) inference profile, specify the inference profile ID or its ARN. For a list of inference profile IDs, see Supported Regions and models for inference profiles in the Amazon Bedrock User Guide.

  • If you use an application inference profile, specify its full ARN, including the account ID and Region.