# overshoot.ai — everything is crawlable. # Explicit groups below document intent and keep AI/search crawlers # unaffected by any future wildcard rules. # --- Search engines (Google, Bing/Copilot, DuckDuckGo, Apple) --- User-agent: Googlebot Allow: / User-agent: bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Applebot Allow: / # --- AI answer-engine search indexing (citations in ChatGPT, Claude, Perplexity) --- User-agent: OAI-SearchBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / # --- AI model training crawlers (allowed: we want models to know Overshoot) --- User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: meta-externalagent Allow: / User-agent: Amazonbot Allow: / User-agent: CCBot Allow: / # --- User-triggered fetchers (browse/answer requests from AI assistants) --- User-agent: ChatGPT-User Allow: / User-agent: Claude-User Allow: / User-agent: Perplexity-User Allow: / # --- Everyone else (Brave, Exa, xAI/Grok, and future crawlers) --- User-agent: * Allow: / Sitemap: https://www.overshoot.ai/sitemap.xml