Apify builder

AI Crawl Ready

@aicrawlready $$$$$ Revenue rank #3,444 ↓ -212

Tools for checking how AI crawlers and search bots can access your site.

Leaderboard position

out of 10,354

New actors

-

Total actors

#4,619

↓ -1,434

Monthly users

#4,957

↓ -1,441

Total users

#6,548

↓ -1,527

Monthly runs

#4,592

↑ +1,337

Total runs

#7,436

↓ -493

Portfolio stats

New actors

0

↓ -2

Total actors

2

+0

Monthly users

2

+0

Total users

4

+0

Monthly runs

58

↑ +36

Total runs

82

↑ +56

New actors

Actors published by day

Each bar shows one day in the last 30 days.

Oct 8 Nov 6

Portfolio concentration

Actors driving most users

2 of 2 actors cover 80%+ of monthly users.

AI Crawler & robots.txt Readiness Audit

Checks each domain's robots.txt for 21 vendor-documented AI crawler tokens (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot and more): allowed, blocked or not mentioned, with the deciding rule and line. Also reports Sitemap lines, llms.txt presence and Content-Signal lines.

1 users/m View on Apify

50%

users

llms.txt Validator & Generator

Validate /llms.txt against the llmstxt.org format with a 0-100 score, per-check pass/warn/fail, broken-link check and fix suggestions, or generate a draft llms.txt from a site's sitemap and page metadata.

1 users/m View on Apify

50%

users

ActorHunt MCP

Feed your AI agent workflows with better Apify Store data.

ActorHunt gives paid members MCP access to keyword data, actor evidence, and Store movement for deciding what to build next.