Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

_bush Pig

1. A tore up looking woman that you would not touch even after a 12 pack Look at that bush pig. See jason..

Zaloopa

1. In Russian – a prepuce. The thick skin, that covering a head of a penis. Under this skin the smegma often accumulates. Written "çà..

W0w

1. Usually used in chat. The sarcastic version of the expression "wow" w0w, that's the fourth time this month you were depr..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning