Robots.txt

What is Robots.txt?


1.

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM


35

Random Words:

1. to chill, mellow out, or kill the noise. Mainly used by Piru members Youngin, 40-b dat or i'll put u down, ya feel me? See 40, 40..
1. A game played on cafeteria tables, with a row of spoons as the net. You hit it but it has to hit your side before it hits the other side..
1. Woke Up Inside My Dad The Unfortunate act of becoming sickeninly drunk, and waking up inside your dad. "dude, i got retarded off ..