Crawls a site you own politely with a standard-library crawler (robots.txt obeyed for its own user agent, retries with back-off, sitemap index and .gz sitemaps read, rate, page and depth limits, every template and locale sampled) and reports technical SEO findings per URL with evidence – status codes.
Crawls a site you own politely with a standard-library crawler (robots.txt obeyed for its own user agent, retries with back-off, sitemap index and .gz sitemaps read, rate, page and depth limits, every template and locale sampled) and reports technical SEO findings per URL with evidence - status codes, redirect chains and loops, broken internal links, canonicals that point at redirects, errors or noindex pages, noindex or redirected URLs in the sitemap, robots rules that block CSS/JS, missing or duplicate titles and H1s, hreflang that is not reciprocal, mixed content, near-duplicate and thin pages - ending in a PASS/FAIL/BLOCKED gate. Use when someone asks "crawl our site for SEO issues", "find broken links and redirect chains", "check our canonicals and sitemap", "why are pages not indexed", "technical SEO audit of staging before launch", or as the second step of this pack. Do NOT use for a one-page on-page review (use the free technical-seo-checker skill), for JavaScript-rendered apps whose content only exists after scripts run (this reads server HTML), or for sites you may not crawl.This is the skill's description: the text your AI reads to decide when the skill applies.
This is the skill's header. The step-by-step instructions are paid content and aren't shown here.
site-crawl-audit/SKILL.md
---
name: site-crawl-audit
description: Crawls a site you own politely with a standard-library crawler (robots.txt obeyed for its own user agent, retries with back-off, sitemap index and .gz sitemaps read, rate, page and depth limits, every template and locale sampled) and reports technical SEO findings per URL with evidence - status codes, redirect chains and loops, broken internal links, canonicals that point at redirects, errors or noindex pages, noindex or redirected URLs in the sitemap, robots rules that block CSS/JS, missing or duplicate titles and H1s, hreflang that is not reciprocal, mixed content, near-duplicate and thin pages - ending in a PASS/FAIL/BLOCKED gate. Use when someone asks "crawl our site for SEO issues", "find broken links and redirect chains", "check our canonicals and sitemap", "why are pages not indexed", "technical SEO audit of staging before launch", or as the second step of this pack. Do NOT use for a one-page on-page review (use the free technical-seo-checker skill), for JavaScript-rendered apps whose content only exists after scripts run (this reads server HTML), or for sites you may not crawl.
---
… the full instructions are part of a premium pack and load in your AI once you have access.