Home / Mini Apps / Free Sitemap & Robots.txt Validator

Free tool

Free Sitemap & Robots.txt Validator

Enter your domain. We fetch /robots.txt and your sitemap, then check for the mistakes that quietly keep pages out of Google.

Free sitemap and robots.txt validator. Checks both files exist, the sitemap is well-formed, and robots.txt isn't silently blocking your own pages. No signup.

  • Domain

Validate

Example

northwind.com

Title. Meetings become a backlog.

Meta description. None

80/100 Checks passed

Title. The right length.

Meta description. Missing.

How it works

  1. 1

    Paste a URL

    Enter any public page. Add a second URL to compare it against your own.

  2. 2

    Press validate

    We fetch the page, read its HTML and report on how it is built.

  3. 3

    Read the result

    You get checks passed, plus every on-page check, the detected stack.

What gets checked

Six checks that catch the mistakes that quietly keep whole sections of a site out of search results.

robots.txt exists and is reachable.
robots.txt isn't blocking the entire site with a blanket Disallow.
robots.txt references a sitemap.
The sitemap is reachable and well-formed XML.
No sitemap URLs are also blocked by a Disallow rule (a common, silent conflict).
lastmod dates aren't all stale.

Why this trips founders up

A migration, a new CMS, or a well-meaning "block staging paths" rule in robots.txt can end up blocking real pages that are still listed in your sitemap — Google follows robots.txt, so those pages get skipped even though you're telling search engines they exist.

What this does not do

  • A regex-based check, not a full XML schema validator — it catches the common mistakes, not every possible malformed edge case.
  • Only the first sitemap referenced in robots.txt (or the conventional /sitemap.xml) is fully checked. A sitemap index is followed one level deep, into its first listed sitemap only.
  • Disallow-vs-sitemap conflicts only check the `*` and Googlebot user-agent groups.
  • "Stale" means the URL's own lastmod date is older than 180 days — that is a heuristic threshold, not a Google requirement.

Frequently asked questions

Is this validator free?
Yes, completely free — no signup. Enter your domain and get a checklist in seconds.
What is a Disallow/sitemap conflict?
It's when a URL is listed in your sitemap (telling crawlers "index this") but also blocked by a Disallow rule in robots.txt (telling crawlers "don't crawl this"). Crawlers follow the block, so the page silently gets skipped.
My sitemap is a sitemap index — will it check everything?
It follows the first listed sitemap in the index one level deep and checks that one. If you have many child sitemaps, run this per key section if you want full coverage for now.
What if I don't have a robots.txt?
That's flagged as a warning, not a hard fail — crawlers assume everything is allowed with no robots.txt. It's still good practice to add one that at least references your sitemap.
What counts as a stale lastmod?
Any sitemap entry whose <lastmod> date is older than 180 days. It's a heuristic flag to review, not something Google requires.
Does it fix anything for me?
No — it's a diagnostic tool. It tells you exactly what's wrong (and which URLs) so you can fix robots.txt or your sitemap generator yourself.

Other free tools

  • Reddit Best Time to Post Calculator

    Free Reddit best-time-to-post calculator. Enter a subreddit for an estimated day/hour heatmap of when engagement is likely highest. No signup.

  • Fake MRR Chart Generator

    Free fake MRR chart generator. Pick start and target MRR, choose a growth curve, style the chart, and download a PNG. Runs in your browser. Synthetic data only.

  • Free Bulk Backlink Checker

    Free bulk backlink checker. Paste a domain for Domain Rating, referring domains, backlinks and spam score. Free signup required.

  • Free Broken Link Checker

    Free broken link checker. Paste a page and we check every link on it for 4xx, 5xx, timeouts and redirects. No signup.

  • JavaScript SEO Checker

    Free SPA shell checker. Paste your website to see if crawlers get real HTML or an empty JavaScript shell. No signup.

  • Domain Authority Checker

    Free bulk Domain Authority checker. Paste up to ten domains for DA, Page Authority, Spam Score and linking root domains. Free signup required.

List your product when the page is ready for founders to find it.