User-agent: * Allow: / # Private or personal surfaces only (not public content): Disallow: /_o/admin/ Disallow: /go/ Disallow: /go-beacon/ Disallow: /arena/lab/ Disallow: /arena/api/ Disallow: /arena/me/ Disallow: /arena/p/ Disallow: /arena/workshop/ Disallow: /arena/cohort/ Disallow: /arena/team/ Disallow: /arena/pl/ Disallow: /arena/packs/ Disallow: /gem/owner/ Disallow: /gem/feed/ Disallow: /gem/card/ # Search result URLs (/search/?q=) are noindexed via X-Robots-Tag and meta robots. # They stay crawlable so the site SearchAction can be verified. The /search/ form is public. # Language models and research crawlers are welcome on every public page. # We do not enable Bot Fight Mode, AI-bot blocking, zone rate limits, or robots Disallows that hide public content. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / User-agent: ClaudeBot Allow: / User-agent: Anthropic-AI Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / # Briefings: https://www.chyp.ai/llms.txt , https://www.chyp.ai/llms-full.txt , https://www.chyp.ai/.well-known/llms.txt , https://www.chyp.ai/humans.txt Sitemap: https://www.chyp.ai/sitemap-index.xml Sitemap: https://www.chyp.ai/sitemap.xml