Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

[shtoop]

1. The act of engaging in sexual activity with another individual. I finally shtoop'd an Asian girl. See screw, fuck, schtoop, shtop..

Kizbizbang

1. fuckin a fat ugly ass hoe i kizbizbanged this one chick it was awesome See bizz, bang, mom, fat, ugly 2. means fuck a big fatass ch..

Paddy Whacker

1. A policeman's truncheon or baton. Arose from the fact that the Irish were generally on the wrong side on the law in the New World a..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning