# robots-ai.txt Specification (ADF-010) # https://www.ai-visibility.org.uk/specifications/robots-ai-txt/ # AI Crawler Directives for Switching for Business # Website: https://switchingforbusiness.com # Last Updated: 2026-10-17 # # This file provides supplementary AI-specific guidance. # Standard robots.txt remains the authoritative source for all crawlers. # AI usage permissions are defined in ai.txt and ai.json. # OpenAI (ChatGPT) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Anthropic (Claude) User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Google (Gemini) User-agent: Google-Extended Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Perplexity User-agent: PerplexityBot User-agent: Perplexity-User Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Meta AI User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: Meta-WebIndexer Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # DuckDuckGo User-agent: DuckAssistBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Apple User-agent: Applebot User-agent: Applebot-Extended Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Amazon User-agent: Amazonbot Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # ByteDance User-agent: Bytespider Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Common Crawl User-agent: CCBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Cohere User-agent: cohere-ai Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 # Any other AI crawler — including agents that publish no user-agent token # (e.g. xAI's Grok), which are also covered by the standard robots.txt. User-agent: *-ai Allow: / Disallow: /admin Disallow: /api/ Disallow: /framework/_rendered/ Crawl-delay: 10 Sitemap: https://switchingforbusiness.com/sitemap.xml Discovery: https://switchingforbusiness.com/llms.txt Discovery: https://switchingforbusiness.com/llm.txt Discovery: https://switchingforbusiness.com/llms.html Discovery: https://switchingforbusiness.com/ai.txt Discovery: https://switchingforbusiness.com/ai.json Discovery: https://switchingforbusiness.com/identity.json Discovery: https://switchingforbusiness.com/brand.txt Discovery: https://switchingforbusiness.com/faq-ai.txt Discovery: https://switchingforbusiness.com/developer-ai.txt Discovery: https://switchingforbusiness.com/robots-ai.txt