Which AI crawlers this checks
The tool reads your robots.txt and reports how it treats sixteen well-known user agents, including OpenAI's GPTBot, OAI-SearchBot and ChatGPT-User, Anthropic's ClaudeBot, Claude-SearchBot and Claude-User, PerplexityBot, Google-Extended, Applebot-Extended, Common Crawl's CCBot, Bytespider, Amazonbot and Meta's crawler. Googlebot and Bingbot are included for comparison so you can see whether you are treating AI and classic search bots differently.
Training bots, search bots and user bots are different
These crawlers do different jobs. Training crawlers such as GPTBot and ClaudeBot collect content for model training. Search crawlers such as OAI-SearchBot and PerplexityBot build an index that can link back to you in answers. User agents such as ChatGPT-User fetch a page because a person asked about it. Some site owners block training but allow search so they stay visible in AI answers, and this table makes it easy to see which of those choices your file currently makes. Google-Extended and Applebot-Extended are control tokens rather than separate crawlers.
How the result is worked out
The checker follows the standard robots.txt matching rules. A bot uses the group whose user-agent line matches it most specifically and falls back to the wildcard group. Within a group the longest matching rule wins, and Allow wins a tie. A bot with no matching group is treated as allowed. A group that blocks only some paths shows as partly restricted.
Limits you should know about
robots.txt is a request, not a lock. Reputable crawlers follow it, others may not. Your host, firewall or CDN may also block or allow bots independently of this file, so a bot marked allowed here can still be turned away at the server. This tool does not read server logs, so it cannot show which bots have actually visited.