{"enrichment":{"faq":[{"a":"ai-bot-log-audit helps you parse access logs to identify AI crawler activity by user agent, request frequency, and timing patterns. Extract GPTBot, ClaudeBot, and PerplexityBot requests, then segment by page, resource type, and time window to understand which content AI agents prioritize and how often they return. This reveals crawl budget allocation and content discovery gaps.","q":"How do I analyze AI bot crawl patterns in server logs?"},{"a":"ai-bot-log-audit diagnoses citation gaps by correlating crawl logs with citation absence. Even if bots crawl your pages, content may not surface due to lost-in-the-middle effects, poor retrieval ranking, or insufficient context density. The tool helps you audit which pages bots see, verify they're being indexed, and identify structural or placement issues blocking citation probability.","q":"Why isn't my content cited in ChatGPT or Perplexity answers?"},{"a":"ai-bot-log-audit lets you filter logs by bot user agent and compare crawl frequency, request patterns, and resource consumption across different AI products. Track which bot visits which pages, how often each returns, and whether they respect crawl-delay rules. This side-by-side analysis reveals product-specific indexing strategies and helps you prioritize optimization efforts.","q":"How can I compare GPTBot vs PerplexityBot crawl behavior?"},{"a":"ai-bot-log-audit grounds optimization in actual bot behavior data. Analyze crawl logs to identify undervisited high-value pages, then improve content placement and retrieval mechanics\u2014such as reducing lost-in-the-middle risk by front-loading key claims. Use crawl frequency trends to refine robots.txt rules and content structure, ensuring AI agents encounter your most citation-worthy material first.","q":"What's the best way to optimize content for AI search visibility?"},{"a":"ai-bot-log-audit parses standard server logs (Apache, Nginx, CloudFront) to isolate AI bot traffic by matching known user agents and IP ranges. Filter requests, aggregate by bot type and time period, and generate reports on crawl volume, page coverage, and request timing. Export cleaned datasets for further analysis or feed into your content strategy pipeline.","q":"How do I extract AI crawler activity from my access logs?"},{"a":"ai-bot-log-audit surfaces crawl frequency per page, bot-specific visit patterns, request timing, and resource usage. Track which content AI bots prioritize, how citation gaps correlate with crawl gaps, and how your crawl budget shifts over time. Combine these metrics with lost-in-the-middle and retrieval mechanics insights to refine placement, structure, and content density for maximum AI visibility.","q":"What metrics should I track to build an AI search strategy?"}],"shadow_tags":["ai-search-optimization","crawl-pattern-analysis","llm-retrieval-mechanics","log-file-parsing","geo-strategy","citation-gap-diagnosis","content-placement-strategy","ai-traffic-monitoring","bot-behavior-comparison","search-visibility-audit"],"summary_rewrite":"Track and interpret how AI agents interact with your infrastructure by examining server logs for bot activity patterns. Gain actionable insights into crawl frequency, request timing, and resource usage to refine your content strategy and improve bot-to-human traffic balance. Essential for teams managing high-volume AI agent access."},"files":[{"bytes":15535,"path":"skills/seo-tools/ai-bot-log-audit/SKILL.md","sha256":"3eb6737f91e339a7fdb263b4a6613fb19370c6fbbd3fd8432247666eb106e8ad","url":"https://skillfed.io/files/guia-matthieu/clawfu-skills/ai-bot-log-audit/8dfc675b/SKILL.md"}],"id":"guia-matthieu/clawfu-skills/ai-bot-log-audit","links":{"html":"https://skillfed.io/guia-matthieu/clawfu-skills/ai-bot-log-audit","md":"https://skillfed.io/guia-matthieu/clawfu-skills/ai-bot-log-audit.md","repo":"https://github.com/guia-matthieu/clawfu-skills"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":28,"language":"Python","last_updated":"2026-04-02","license":"MIT","name":"ai-bot-log-audit","publisher":"guia-matthieu","stars":140},"relations":{"similar":[{"id":"zubair-trabzada/geo-seo-claude/geo-crawlers"},{"id":"kostja94/marketing-skills/robots"},{"id":"alinaqi/maggy/site-architecture"},{"id":"montagao/skills/llm-seo"},{"id":"oldwinter/skills/seo-geo"},{"id":"ReScienceLab/opc-skills/seo-geo"},{"id":"kostja94/marketing-skills/geo"},{"id":"PostHog/posthog/filtering-bot-traffic"},{"id":"PostHog/ai-plugin/filtering-bot-traffic"},{"id":"AgriciDaniel/claude-seo/seo-technical"}]},"slug":{"owner":"guia-matthieu","repo":"clawfu-skills","skill":"ai-bot-log-audit"},"version":"8dfc675b"}