AI Crawler Blocking Checker: GPTBot, ClaudeBot & 15 More
See which AI crawlers each website allows or blocks in robots.txt (GPTBot, ChatGPT-User, ClaudeBot, Google-Extended, PerplexityBot, CCBot, Bytespider, Applebot-Extended, Meta...), plus search bots, crawl-delay, sitemaps and llms.txt presence. Extracts fields: site, robotsStatus, hasRobotsTxt.
1%
users