50+ Free Tools
English
Tools Hub
SEO Tools
Robots.txt Generator
Robots.txt Generator
Guide Googlebot and web spiders with instructions on which paths to index or protect.
Default Robot Access:
Allow All Robots
Disallow All (Block Entire Site)
Crawl Delay (Seconds):
No Delay (Default)
5 Seconds
10 Seconds
20 Seconds
XML Sitemap URL:
Disallowed Paths (One per line):
/admin/ /api/ /tmp/ /private/
Update Robots.txt
Generated Robots.txt:
Copy File