Toolkitcloud
Home
AI Tools
Text
Image
PDF
SEO
Video
Home
Tools
Robots.txt Generator
Robots.txt Generator
Generate a robots.txt file to control search engine crawlers.
Allow all crawlers by default
Disallow paths (one per line)
/admin /private
Sitemap URL
robots.txt
User-agent: * Allow: / Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml
Copy