Which AI crawlers can read your site?
Enter a URL. We read your robots.txt for 18 AI bots, test what really gets through your firewall, and show whether ChatGPT, Claude, and Perplexity can find and cite you.
Reads robots.txt and sends four homepage requests. No signup, nothing stored. The numbers behind it: 26% of top sites block AI crawlers.
What this checks
18 AI bots, one by one
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more, each read against your robots.txt the way the bot itself reads it.
Training vs. search
Blocking training crawlers keeps you out of future models. Blocking search crawlers keeps you out of AI answers today. The check tells the two apart.
What actually gets through
We request your homepage as a browser and as three AI bots. A CDN or firewall that blocks bots shows up here, even when robots.txt says yes.
noai, noindex, llms.txt
Opt-out directives in meta tags and headers, plus whether an llms.txt file exists.
Visible where your buyers ask.
We make sites readable and citable for AI search: crawler policy, structure, schema, and the content AI assistants quote.
