Website Tool

Robots.txt Generator

Create a clean robots.txt file for your website. Control search engine crawling, add sitemap URL and block private WordPress paths.

Website URL

Sitemap URL

Default Search Engine Access

Crawl Delay

WordPress Protection

Block AI Crawlers

Custom Disallow Paths

Custom Allow Paths

Fill the fields and click Generate Robots.txt.

Generated Robots.txt

Copy this file and upload it to your website root folder, for example: example.com/robots.txt

A robots.txt file tells search engine crawlers which parts of your website they can or cannot crawl.

Upload the robots.txt file to your website root directory so it opens at yourdomain.com/robots.txt.