Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
---
name: robots-sitemap-validator
description: Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
license: MIT
metadata:
author: JustHandled Labs
version: 1.0.0
price: $0
credits: 0
triggers:
- check my robots.txt
- validate my sitemap
- is my site crawlable
---
# Robots Sitemap Validator
Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.
## Workflow
1. Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
2. Review findings by rule id, severity, file, and line.
3. Treat missing sibling sitemap files as review flags when robots.txt references them.
… install to load the full skill