Free tool
Free Robots.txt Validator & Sitemap Checker
Enter your domain. We fetch /robots.txt and your sitemap, then check for the mistakes that quietly keep pages out of Google.
Free sitemap and robots.txt validator. Checks both files exist, the sitemap is well-formed, and robots.txt isn't silently blocking your own pages. No signup.
- Domain
Validate
Example
robots.txt found · sitemap reachable · 2 conflicts
5/7
Checks passed
Status Fix conflicts
How it works
-
1
Enter your domain
Just the domain. We fetch /robots.txt and the sitemap it points to, or /sitemap.xml if it lists none.
-
2
Press validate
We run six checks: both files reachable, the sitemap well-formed, no blanket Disallow, and no sitemap URL blocked by robots.txt.
-
3
Fix what failed
Each check passes or fails with a short explanation, plus a prompt you can paste into an AI to write the fix.
What gets checked
Six checks that catch the mistakes that quietly keep whole sections of a site out of search results.
Why this trips founders up
A migration, a new CMS, or a well-meaning "block staging paths" rule in robots.txt can end up blocking real pages that are still listed in your sitemap — Google follows robots.txt, so those pages get skipped even though you're telling search engines they exist.
What this does not do
- A regex-based check, not a full XML schema validator — it catches the common mistakes, not every possible malformed edge case.
- Only the first sitemap referenced in robots.txt (or the conventional /sitemap.xml) is fully checked. A sitemap index is followed one level deep, into its first listed sitemap only.
- Disallow-vs-sitemap conflicts only check the `*` and Googlebot user-agent groups.
- "Stale" means the URL's own lastmod date is older than 180 days — that is a heuristic threshold, not a Google requirement.