# NOTE: Cloudflare may prepend managed rules in production. # If Cloudflare's managed block conflicts with these allows, # adjust in Cloudflare dashboard > Rules > Configuration > Robots.txt. User-agent: * Content-Signal: search=yes,ai-input=yes,ai-train=no Allow: / # AI search crawlers — explicitly allowed for AI Overview / chat search visibility User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / # Block Common Crawl training scraper (not needed for search visibility) User-agent: CCBot Disallow: / Sitemap: https://octocounts.com/sitemap.xml