Crawl Impact Preview

See which pages Googlebot could start or stop crawling after a robots.txt change.

Set up a comparison

An empty robots.txt is treated as having no crawl restrictions.

If you have a sitemap index, add the child sitemap files. Up to 50,000 unique URLs per comparison.

Enter an origin to select one site from a mixed list or to use page paths such as /products/item.