Skip to main content

Technical SEO

XML Sitemaps: Helping Search Engines Find Everything

A machine-readable map of the pages you want indexed.

Quick answer

An XML sitemap is a file listing the URLs you want search engines to index, along with metadata like last-modified dates. It helps crawlers discover pages quickly, especially on large or newly launched sites.

A sitemap does not guarantee indexing, but it tells search engines which pages exist and when they changed. It is essential for large sites, new sites and sites with pages that are not well linked internally.

Check your website

See how your site handles xml sitemaps: helping search engines find everything — free, no account needed.

For business owners

A sitemap is how you hand search engines a tidy list of everything worth indexing, instead of hoping they find each page by following links. It speeds up discovery of new content and is a prerequisite for getting the most out of Google Search Console and Bing Webmaster Tools. Keeping it accurate and current is a core part of technical SEO.

How it works (technical)

A sitemap is XML listing <url> entries, each with a <loc> and optionally <lastmod>, <changefreq> and <priority>. Large sites split into multiple sitemaps referenced by a sitemap index. Best practice is to generate it dynamically so new and updated pages appear automatically, keep only canonical, indexable URLs in it, and reference it from robots.txt.

Real-world example

A content site added hundreds of articles but many went undiscovered for weeks because internal linking was sparse. Publishing an auto-updating XML sitemap and submitting it in Search Console cut discovery time from weeks to days.

Why it matters

Sitemaps accelerate crawling and indexing and are the foundation of search-console setup. Scanners check that one exists, is valid XML, and is referenced from robots.txt.

How to fix it

  1. Generate an XML sitemap listing your canonical, indexable URLs.

  2. Update it automatically whenever pages are added, changed or removed.

  3. Include accurate <lastmod> dates so crawlers know what changed.

  4. Reference the sitemap in robots.txt and submit it in Search Console and Bing Webmaster Tools.

  5. Exclude noindex, redirected and non-canonical URLs from the sitemap.

Best practices

  • Generate dynamically so it never goes stale.

  • Only include URLs that return 200 and are canonical and indexable.

  • Split very large sites into a sitemap index of sub-sitemaps.

Common mistakes

  • Listing redirected, 404 or noindex URLs.

  • Letting a hand-maintained sitemap fall out of date.

  • Forgetting to reference it from robots.txt.

Frequently asked questions

Does a sitemap guarantee indexing?

No. It aids discovery, but search engines still decide what to index based on quality and other signals.

How big can a sitemap be?

Up to 50,000 URLs or 50MB uncompressed per file. Beyond that, split into multiple files with a sitemap index.

Put this into practice

See how your site scores with Plexa Trust — start with a free scan, then unlock the complete audit on Pro.

Scan your website free

See Pro plans · Create account