AI Crawler Access Checker
See which AI bots a website lets in: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more, per its robots.txt. Also checks llms.txt and X-Robots-Tag. Bulk, fast, polite.
20%
users
Apify builder
Helvetic Labs Website checks from Switzerland: broken links, redirects, security headers, sitemaps and AI-crawler access. Pay per result, no personal data.
Leaderboard position
out of 10,354
New actors
#1,188
Total actors
#2,745
↓ -585
Monthly users
#3,257
↓ -581
Total users
#4,742
↓ -655
Monthly runs
#3,652
↑ +3,848
Total runs
#7,064
↑ +1,252
Portfolio stats
New actors
5
Total actors
5
+0
Monthly users
5
+0
Total users
10
+0
Monthly runs
94
↑ +89
Total runs
101
↑ +90
New actors
Each bar shows one day in the last 30 days.
Portfolio concentration
4 of 5 actors cover 80%+ of monthly users.
See which AI bots a website lets in: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more, per its robots.txt. Also checks llms.txt and X-Robots-Tag. Bulk, fast, polite.
20%
users
Get every URL a website lists in its sitemaps, with last-modified dates. Finds sitemaps through robots.txt, reads sitemap indexes and .gz files, and reports invalid or oversized sitemaps.
20%
users
Check thousands of URLs for broken links, redirect chains and slow responses. Status code, final URL, every redirect hop and response time per URL. Respects robots.txt, no personal data.
20%
users
Crawl a website and find broken links, redirect chains, missing or duplicate titles and meta descriptions, missing H1, slow pages and sitemap gaps. A 0-100 score and a fix for every issue. $5 per 1,000 pages.
20%
users
ActorHunt MCP
ActorHunt gives paid members MCP access to keyword data, actor evidence, and Store movement for deciding what to build next.