Crawl budget
The number of URLs Googlebot will crawl on a site in a given period — limited by site authority, server capacity, and demand.
In long form.
Crawl budget rarely matters for sites under 10,000 pages. For larger sites — e-commerce catalogs, news archives, multilingual deep content — wasting crawl budget on duplicate, parameterized, or low-value URLs prevents Googlebot from finding the content that matters. Optimization tactics: fix 404s and redirect chains, consolidate duplicate URLs with canonicals, block infinite parameter combinations in robots.txt, keep server response time fast (TTFB under 200ms is ideal).
On a small marketing site, crawl budget is a red herring. Focus on it only when site size or server slowness is causing measurable indexing gaps in Search Console's Coverage report.
Talk to us about your engagement.
Discovery calls are free. Scope, timelines, and pricing are quoted after we understand what you’re solving.