About the Website Crawl Report
The crawler follows internal links from the URL you give, respects robots.txt and Crawl-delay, waits between requests and stops at your plan's page limit. It reads your XML sitemap to compare what is listed with what is linked.
The report lists broken pages and the pages that link to them, redirect chains, duplicate titles, descriptions and content, missing titles and H1s, canonical problems, non-indexable pages, images without alt text, thin and slow pages, structured data coverage and sitemap gaps. Up to 25 pages without verifying ownership of the site; more with verification and a paid plan.
How it works
- We fetch the URL from our server like a crawler: redirects are followed (up to five), private and internal addresses are refused, and large pages are capped.
- The checks run on the live HTML and response headers. Nothing is guessed: every finding shows what we observed.
- Results are not stored unless you are signed in, in which case they appear in your dashboard history.
Frequently asked questions
Will the crawl slow down my site?
No. It makes one request at a time with at least 0.7 seconds between them, more if your robots.txt sets a Crawl-delay.