Robots.txt Rules File Generator
Generate clean, search engine crawler directives and XML sitemap references for web servers.
Inputs used by this tool
Enter values in the interactive controls when the page loads. The result depends on the assumptions and units shown for each field.
Input type: text
Input type: select
Data handling varies by tool. Review its notes and the Privacy Policy before entering sensitive information.