{"enrichment":{"faq":[{"a":"site-crawlability helps you identify and resolve technical barriers preventing search engines and AI crawlers from accessing your web pages. Start by auditing your robots.txt and sitemap configuration, then fix indexation blockers like broken internal links, orphan pages with no incoming links, and redirect chains. Optimize your site structure to reduce crawl budget waste and ensure all important content is reachable within 3 clicks from your homepage.","q":"How do I improve my site's crawlability for search engines?"},{"a":"site-crawlability identifies orphan pages\u2014content with no incoming internal links that crawlers struggle to discover. Fix them by adding internal links from relevant pages, updating your sitemap to include them, or consolidating orphan content into existing pages. Resolving orphan pages improves indexation and ensures crawlers can reach all your valuable content.","q":"What are orphan pages and how do I fix them for SEO?"},{"a":"site-crawlability optimizes site structure and internal linking to reduce crawl budget waste. It helps you eliminate redirect chains, fix broken internal links, and streamline your site architecture so search engines spend their crawl budget on important pages rather than errors or redundant URLs. This is especially critical for large sites where crawl efficiency directly impacts indexation.","q":"How can site-crawlability help optimize my crawl budget?"},{"a":"site-crawlability recommends pagination with rel=\"prev\" and rel=\"next\" tags for better AI crawler and search engine visibility. Infinite scroll and masonry layouts create crawl traps that prevent bots from discovering all content. Pagination ensures crawlers can navigate through your pages systematically and index all content without hitting URL generation traps.","q":"Should I use infinite scroll or pagination for AI crawler optimization?"},{"a":"site-crawlability diagnoses why content isn't being indexed by AI crawlers like GPTBot and ClaudeBot. It implements server-side rendering (SSR) for better content visibility, optimizes your sitemap and canonical URLs, and fixes crawlable content issues. These improvements help AI platforms discover and index your pages alongside traditional search engines.","q":"How does site-crawlability help with AI bot indexation?"},{"a":"site-crawlability audits robots.txt configuration, broken internal links, redirect chains, orphan pages, sitemap errors, and crawl traps. It resolves indexation blockers, optimizes site structure to improve discoverability, and implements pagination and SSR for better crawler access. The skill diagnoses why content isn't being crawled and provides targeted fixes for search and AI bot discovery.","q":"What technical issues does site-crawlability audit and fix?"}],"shadow_tags":["search-engine-crawling","site-architecture-audit","redirect-management","ai-bot-indexing","pagination-strategy","crawl-waste-reduction","orphan-page-discovery","javascript-rendering-seo"],"summary_rewrite":"This skill helps you identify and resolve technical barriers preventing search engines and AI crawlers from accessing your web pages. Run diagnostics on robots.txt, sitemap configuration, and indexation blockers, then apply targeted fixes to improve discoverability across search and AI platforms."},"files":[{"bytes":7764,"path":"skills/seo/technical/crawlability/SKILL.md","sha256":"50f4a967c11ce185ec8f87be7d78ffb266663d711a2d5b31088b24b4857165b3","url":"https://skillfed.io/files/kostja94/marketing-skills/crawlability/d0499b15/SKILL.md"}],"id":"kostja94/marketing-skills/crawlability","links":{"html":"https://skillfed.io/kostja94/marketing-skills/crawlability","md":"https://skillfed.io/kostja94/marketing-skills/crawlability.md","repo":"https://github.com/kostja94/marketing-skills"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":109,"language":null,"last_updated":"2026-06-09","license":"MIT","name":"site-crawlability","publisher":"kostja94","stars":762},"relations":{"similar":[{"id":"rampstackco/claude-skills/seo-technical"},{"id":"kostja94/marketing-skills/geo"},{"id":"kostja94/marketing-skills/robots"},{"id":"kostja94/marketing-skills/rendering-strategies"},{"id":"zubair-trabzada/geo-seo-claude/geo-technical"},{"id":"kostja94/marketing-skills/masonry"},{"id":"AgriciDaniel/codex-seo/seo-technical"},{"id":"aaron-he-zhu/aaron-marketing-skills/technical-seo-checker"},{"id":"AgriciDaniel/claude-seo/seo-technical"},{"id":"indranilbanerjee/digital-marketing-pro/technical-seo"}]},"slug":{"owner":"kostja94","repo":"marketing-skills","skill":"crawlability"},"version":"d0499b15"}