Robots.txt Generator


A robot.txt file informs robots (aka wanderers, spiders,
search engines, etc) as to which directories and files NOT to access.
This file must be accessable within your root HTTP on
the local URL "/robots.txt".

Here's your code...

Simply create a empty text document and cut &
paste this code into it.
Name it "robot.txt" and upload it to your ROOT directory.
  

List files and directories that you want to DISALLOW
or PREVENT robots from visiting on separate lines.
For directories, end with a backslash (/). DON'T NOT USE
wildcard symbols, such as the asterick (*)!


Individual files like:
  /private.html
  /nonions.doc



    

Home | Earnings Disclaimer | Anti Spam | Terms of Use | Privacy Policy | Contact Us
Free Online Tools | Articles | Press Releases | Trade Links

Copyright © 2005-2007 Lang Enterprises Inc. All rights reserved
688 Pole Line Rd # 75 • Twin Falls, Id 83301
Phone: (509) 994-7379 • Click Here to Email Us