Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Bulletproof Insult

1. One of few insults in which there is no effictive comeback. Bob-"Dude did you hear about John's bulletproof insult?" Fr..

Fuckpouch

1. 1. An orifice used for fucking. 2. A coward or pussy. A low level nobody. 1. Bend 'ova honey, I got somethin' for ya fuckp..

High Diver

1. A turd deposited into the toilet bowl at such a high speed that it causes spashback directly onto the spectating testicles Cured by the ..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning