# Default WP rules user-agent: * disallow: /wp-admin/ allow: /wp-admin/admin-ajax.php disallow: /wp-content/plugins/ disallow: /readme.html disallow: /refer/ disallow: /cdn-cgi/ Sitemap: https://akerink.com/sitemaps.xml # AI crawler accessibility (augmented by akerink-bot-router) # Adds explicit Allow blocks for canonical AI UAs from the GEO scoring rubric. # Origin robots.txt content above is preserved verbatim. # WARNING: All User-agent lines below must remain in a SINGLE group (no blank # lines between them). Each bot must also repeat origin's wildcard rules, because # RFC 9309 says a crawler obeys only its most-specific matching group and ignores # User-agent: *. # LIMITATION: this only covers the UAs WE append. Bots that ORIGIN # already declares keep their own Allow-only groups and still ignore # the rules above; appending cannot fix those without mutating origin, # which we never do. See bead rober-bfgz. User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Google-Extended User-agent: GoogleOther User-agent: Gemini User-agent: Gemini-AI User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: Applebot User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: Diffbot User-agent: cohere-ai User-agent: MistralBot User-agent: DeepSeekBot User-agent: AI2Bot User-agent: Grok disallow: /wp-admin/ allow: /wp-admin/admin-ajax.php disallow: /wp-content/plugins/ disallow: /readme.html disallow: /refer/ disallow: /cdn-cgi/