Crawl Budget Calculator

Turning site size into a crawl target

Large sites, especially those with tens of thousands of pages, benefit from understanding how quickly a search engine would need to crawl to keep the whole site reasonably fresh in its index.

Worked example

For a 5,000-page site targeting full re-crawl within 30 days:

Pages Per Day = ceil(5000 / 30) = 167 pages/day needed

Frequently asked questions

How do I check my actual crawl rate? Google Search Console's Crawl Stats report (under Settings) shows the average pages crawled per day over recent history - compare that figure directly against this calculator's result to see whether your site's actual crawl budget can keep pace with its size.

What if my actual crawl rate falls short? Common fixes include improving site speed, trimming low-value or duplicate pages, fixing broken internal links, and strengthening internal linking to important pages so crawlers reach them more efficiently.