Home
Web Tools
Blog
FAQs
About Us
Contact Us
Robots.txt Generator
Default - All Robots are
Allow
Disallow
Crawl-Delay
Default - No Delay
5 Seconds
10 Seconds
20 Seconds
60 Seconds
120 Seconds
Sitemap
Leave blank if you don't have.
Search Robots:
Google
Same as Default
Allow
Disallow
Google Image
Same as Default
Allow
Disallow
Google Mobile
Same as Default
Allow
Disallow
MSN Search
Same as Default
Allow
Disallow
Yahoo
Same as Default
Allow
Disallow
Yahoo MM
Same as Default
Allow
Disallow
Yahoo Blogs
Same as Default
Allow
Disallow
Ask/Teoma
Same as Default
Allow
Disallow
GigaBlast
Same as Default
Allow
Disallow
DMOZ Checker
Same as Default
Allow
Disallow
Nutch
Same as Default
Allow
Disallow
Alexa/Wayback
Same as Default
Allow
Disallow
Baidu
Same as Default
Allow
Disallow
Naver
Same as Default
Allow
Disallow
MSN PicSearch
Same as Default
Allow
Disallow
Disallow Folders
The path is relative to the root and must contain a trailing slash "/".
Generate
Related Tools
QR Code Decoder
Open Graph Checker
QR Code Generator
Base64 Encode
Credit Card Generator
Credit Card Validator
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.
Accept all cookies
x
