Robots.txt Generator â€“ Build Custom Robots.txt Files

Build custom robots.txt files with user-agent directives and sitemap locations.

Processed 100% locally in your browser. Never sent to our server.

Sitemap URL:

Allow all search crawlers by default (Allow: /)Disallow admin directory (/admin)Disallow API endpoints (/api/)

Generated Robots.txt:

# Robots.txt generated by Numvax (https://Numvax.com)
User-agent: *
Allow: /
Disallow: /admin
Disallow: /admin/*
Disallow: /api/

Sitemap: https://Numvax.com/sitemap.xml

About Robots.txt Generator â€“ Build Custom Robots.txt Files

Generates standardized robots.txt instructions to guide search engine crawlers (Googlebot, Bingbot) across web pages.