Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Vagina Shelf

1. The gap that forms between a standing woman's thighs, all the way up to her vagina, when she is anorexicand her pants are tight eno..

Jackaroo

1. 1. An extremely attractive male one would flirt or "mac on" 2. The male equivilant of a "biddie" 3. Prime male mac..

C-p

1. Chat lingo for Sleepy. Im tired but not C-P. See chat, lingo, for, sleepy..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning