Developer

Robots.txt Generator

Generate robots.txt

Allow crawling by default

Extra disallowed paths (one per line)

Sitemap URL

robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/

Sitemap: https://example.com/sitemap.xml