WebCrawlerLimits¶
Structure Class¶
WebCrawlerLimits
dataclass
¶
Bases: _SerdeShape
The rate limits for the URLs that you want to crawl. You should be authorized to crawl the URLs.