Crawler Protocol Permissions
Explicitly Welcoming Every Major AI Spider
While millions of sites accidentally block AI bots behind CDN firewalls, AI-Vision exposes deterministic routes (`/llms.txt`, `/sitemap.xml`, `/tool/:slug`, and `/robots.txt`) tuned for zero-friction entity discovery.
OpenAI SearchGPT
● GPTBot / OAI-SearchBot Allowed
Perplexity Sonar
● PerplexityBot Allowed
Anthropic Claude
● ClaudeBot Allowed
Google Gemini
● Google-Extended Allowed