Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

W.u.g

1. Like wen u in da street in u in a low down u make money asking da other dude W.U.G wich means Wat u got. Like trade your asking him for ..

Hammer-rail

1. To do a line of cocaine off another's penis I was really drunk last night, and some dude pulled out his dick and put some good dru..

Vomitis Mass

1. something disgusting/degrading... you are such a vomitis mass! See disgusting, degrading, horrible, rotten, sick, dirty, fuck, what?..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning