AI Crawler Access Checker (robots.txt + llms.txt)
Check which AI bots each website allows or blocks: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and 25+ more, using RFC 9309 robots.txt matching. Also detects llms.txt and llms-full.txt, sitemaps, meta robots and noai tags. Bulk, fast, no browser.
14%
users