Robots.txt Generator & Tester
Control how search engines crawl your site.
⚡ Quick Presets
Select common patterns to auto-fill rules.
Global Rules (*)
Custom Rules
Testing Tool
Check if a URL is blocked by the rules above.
Control how search engines crawl your site.
Select common patterns to auto-fill rules.
Check if a URL is blocked by the rules above.