The crawler includes a cache functionality to optimise performance and reduce costs. If a page has not changed since the last crawl, the crawler retrieves it from the cache instead of re-crawling it. Such retrievals are not billed, as they are considered non-billable cache fetches. For more details, refer to the crawler cache documentation. This cache functionality is enabled by default in the crawler configuration.