AI crawler robots.txt generator
Free AI Crawler Robots.txt Generator & Checker
Source
Tiny Tool Town listing
No-Login listing
llms.txt
Sitemap
Policy
0 agents
Search visible
Block selected
Custom
Disallow paths
/private/ /account/ /checkout/ /wp-admin/
Allow paths
/blog/ /docs/
Additional user-agent tokens
Copy robots.txt
Download
Output
Ready
Audit
Sample
Paste existing robots.txt
Findings
Waiting
OpenAI crawlers
Anthropic crawlers
Google crawler tokens
Perplexity crawlers