Thursday, October 20, 2005

Robots.txt

Hosting technical support has confirmed that folder location that I put the robots.txt file is correct. The text within it is simple

User-agent: *
Disallow: /

That's to say, all crawlers, everything is disallowed.

No comments:

Post a Comment