Skip to content

FixedSizeChunkingConfiguration

Structure Class

FixedSizeChunkingConfiguration dataclass

Bases: _SerdeShape

Configurations for when you choose fixed-size chunking. If you set the chunkingStrategy as NONE, exclude this field.

Attributes

max_tokens instance-attribute
max_tokens: int

The maximum number of tokens to include in a chunk.

overlap_percentage instance-attribute
overlap_percentage: int

The percentage of overlap between adjacent chunks of a data source.