Skip to content

HarnessLiteLlmModelConfigDict

Dictionary Type

HarnessLiteLlmModelConfigDict

Bases: TypedDict

Dictionary form of HarnessLiteLlmModelConfig.

Attributes

additional_params instance-attribute
additional_params: Document | None

Provider-specific parameters passed through to the model provider unchanged.

api_base instance-attribute
api_base: str | None

The base URL for the model provider's API endpoint.

api_key_arn instance-attribute
api_key_arn: str | None

The ARN of the API key in AgentCore Identity for authenticating with the model provider.

max_tokens instance-attribute
max_tokens: int | None

The maximum number of tokens to allow in the generated response per iteration.

model_id instance-attribute
model_id: Required[str]

The LiteLLM model identifier (e.g., "anthropic/claude-3-sonnet").

temperature instance-attribute
temperature: float | None

The temperature to set when calling the model.

top_p instance-attribute
top_p: float | None

The topP set when calling the model.