Technical SEO

Robots.txt Generator

Build a robots.txt file visually — add bot rules, allow/disallow paths, crawl delays and sitemaps, then download in one click.

⚡Quick Templates
📋Bot Rules
0 rules
🗺️Sitemap URLs
⏱️Global Crawl Delay
seconds
Optional. Tells bots how long to wait between requests. Supported by some crawlers.
📄robots.txt
0 lines 
# robots.txt — add rules to generate your file
✅Validation
Add rules to see validation tips
📖Quick Reference
User-agent: * — applies to all bots
User-agent: Googlebot — Google only
Allow: /path/ — permit crawling
Disallow: /path/ — block crawling
Disallow: — (empty) allow everything
Disallow: / — block everything
Sitemap: https://… — sitemap location
Crawl-delay: 10 — seconds between requests