How to use robots.txt

What is the purpose of the robots file?
This file tells search engines what they should and should not index (make available as links).

You can simply create a blank file and name it robots.txt. (This will reduce site errors and allow all search engines to rank you if they want.)

If you want to stop search engines from ranking you, use this code:
#Code to not allow any search engines!
User-agent: *
Disallow: /


See more codes here:

http://www.robotstxt.org/robotstxt.html

  • Email, SSL
  • 13000 Users Found This Useful
Was this answer helpful?

Related Articles

Bandwidth pro

Bandwidth is the amount of data that can be transferred to and from your account in one month....

Can I use my account and my site if domain name hasn't propagated

Yes, you can use your website without a domain name.We provide you a temporary URL in your...

default.html, start page

This is a home page provided by HDWEBPROVIDER™. You may delete it at anytime.Normally, when you...

Dreamweaver, WordPress Direct, Excite, XSite publishing

These programs work well for publishing to your primary domain name, but it can be tricky to...

Email verification for tickets

Box trapper helps us reduce spam. The first time you submit a ticket, you will need to check your...