Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Stewing Rhubarb

1. Smoking dope; comes from the similar smell of boiling rhubarb John was having a bad day and decided when he got home he was going to be..

M2b

1. m.2.b = meant to be.... they are meant to be(m2b) friends See dear, boyfriend, girlfriend, friend, sexy..

The Groucho Marx

1. To place male genitals over the eyes of a sleeping person, whereas the penis lays along the bridge of the nose. Ha, did you see the pic..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning