User-Agent: * Allow: / Disallow: /admin Disallow: /api/ User-Agent: GPTBot User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Claude-Web User-Agent: anthropic-ai User-Agent: PerplexityBot User-Agent: Google-Extended User-Agent: Applebot-Extended User-Agent: CCBot Allow: / Host: https://agentgauge.ai Sitemap: https://agentgauge.ai/sitemap.xml