Crawl a site and build sitemap.xml

XML Sitemap Generator

Enter your homepage, download a clean XML sitemap and submit it to Google Search Console.

Try an example
Free to use No account required

Inspect an XML sitemap for a website

Each page's status, robots meta tag, X-Robots-Tag, canonical and robots.txt rules are checked, and only canonical 200 pages that may be indexed go into sitemap.xml, with lastmod from Last-Modified.

Interpret the result

Upload the file to your site root, reference it in robots.txt and submit it in Google Search Console, then regenerate it when you add or remove pages.

Prioritize fixes

One crawl fetches up to 45 URLs on Cloudflare's free plan, pages reachable only through JavaScript or forms are not found, and large sites should generate sitemaps from their CMS.

How to interpret an XML sitemap for a website

Each page's status, robots meta tag, X-Robots-Tag, canonical and robots.txt rules are checked, and only canonical 200 pages that may be indexed go into sitemap.xml, with lastmod from Last-Modified.

Limits of this check

One crawl fetches up to 45 URLs on Cloudflare's free plan, pages reachable only through JavaScript or forms are not found, and large sites should generate sitemaps from their CMS.

Frequently asked questions

What does this tool check?

Each page's status, robots meta tag, X-Robots-Tag, canonical and robots.txt rules are checked, and only canonical 200 pages that may be indexed go into sitemap.xml, with lastmod from Last-Modified.

How should I use the result?

Upload the file to your site root, reference it in robots.txt and submit it in Google Search Console, then regenerate it when you add or remove pages.

What are the limits?

One crawl fetches up to 45 URLs on Cloudflare's free plan, pages reachable only through JavaScript or forms are not found, and large sites should generate sitemaps from their CMS.

Related URL tools and guides