Robots.txt

What is Robots.txt?


1.

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM


35

Random Words:

1. Like a zamboni. That floor polisher in the commons is very zambonesque. See zamboni, polishing, i, don't, know..
1. an STD That nigga got the monkeys from some bitch up the block that everbody fucked raw See Tiffany 2. a STD Eww bitch get away fro..
1. Electro Magnetic Fields- the numbers that show if there is paranormal activity. For example, if the number indicates that an EMF reading..