XML Sitemap

An XML sitemap is a file that lists the URLs on a website that you want search engines to discover and index, written in the structured format defined by the sitemaps.org protocol. It acts as a roadmap for crawlers such as Googlebot and Bingbot, helping them find important pages faster, especially on large, new or frequently updated sites. A sitemap does not guarantee indexing, but it gives search engines a clear signal about which pages you consider important.

Key elements of an XML sitemap include:

• URL entries: Each page is listed with its full, canonical address in a loc tag.
• Last modified date: The optional lastmod value tells crawlers when a page last changed meaningfully. Google uses it when it is consistently accurate.
• Optional hints: The protocol also includes changefreq and priority fields, but Google has stated that it ignores them.
• Size limits: A single sitemap can hold up to 50,000 URLs or 50 MB uncompressed. Larger sites split URLs across multiple files listed in a sitemap index.
• Specialized sitemaps: Image, video and news extensions add extra details for those content types.

Why XML Sitemaps Matter

1. Faster discovery: New pages and updates can be found sooner, without waiting for crawlers to reach them through links.
2. Coverage of hard-to-reach pages: Pages deep in the site structure, or with few links pointing to them, are easier for crawlers to locate.
3. Diagnostic insight: Submitting a sitemap in Google Search Console and Bing Webmaster Tools lets you compare submitted pages with indexed ones and spot problems.
4. Support during change: During a website migration, an updated sitemap helps search engines find and process the new URLs.
5. Stronger technical foundation: A clean sitemap is a core part of technical SEO and reflects a well-maintained site.

Real-World Example of an XML Sitemap

A B2B software company publishes several blog posts each week and maintains hundreds of product and integration pages. Its CMS generates a sitemap index that points to separate sitemaps for blog posts, product pages and landing pages, each entry with an accurate last modified date. In Search Console, the marketing team notices that many integration pages are submitted but not indexed. That insight leads them to expand thin content and add links to those pages from related articles.

How to Create and Maintain an XML Sitemap

Most modern platforms generate sitemaps automatically. Webflow, for example, can generate a sitemap that updates whenever you publish, and also lets you supply a custom one. Check that the sitemap includes only canonical, indexable pages that return a 200 status code. Exclude redirects, error pages, duplicates and URLs marked noindex, since mixed signals waste crawl attention and muddy your reports.

Reference the sitemap location in your robots.txt file and submit it in Google Search Console and Bing Webmaster Tools. Review the indexing reports regularly and investigate pages that are submitted but excluded. Remember that a sitemap complements, rather than replaces, solid internal linking, which remains the main way both crawlers and people discover content.

Conclusion

An XML sitemap is a simple file with an outsized role in technical SEO. Kept accurate and clean, it helps search engines find, understand and prioritize your most important pages.

Need Help With Your XML Sitemap?

Artifact builds and audits websites with technical SEO built in, from sitemaps and structured data to complex migrations. If search engines are missing your key pages, we can help you find out why and fix it. Tell us about your project