Skip to content

InvokeModelTokensRequest

Structure Class

InvokeModelTokensRequest dataclass

Bases: _SerdeShape

The body of an InvokeModel API request for token counting. This structure mirrors the input format for the InvokeModel operation, allowing you to count tokens for raw text inference requests.

Attributes

body instance-attribute
body: bytes

The request body to count tokens for, formatted according to the model's expected input format. To learn about the input format for different models, see Model inference parameters and responses.