Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Vaginal Creamist

1. Dan Krusch's created word. A vaginal creamist means to be someone who is of creaming of the vagina. Usually you can use it in any c..

Man Tartar

1. someone who is nothing more than a simple cumshot of an individual. Hey, man tartar, get me the remote...

Omgfml

1. oh my god, fuck my life. dude i have been at work for the past 22 hours, omgfml! See sucks, shitty, gay, fuck, shit..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning