Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Fatty Fatty Bom Bom

1. An insulting and often humorous name given to the circumferentially challenged among us. Damn that boy got some girth, fatty fatty bom ..

Zandy

1. someone who is utterly crazy/insane and a fan of the ridiculous you are totally zandy! 2. Zandy: A man who is ridiculously cool who l..

Imaseskibishh

1. the poster child for a botched abortion. The one who is not smart enough to put together simple words and make sure they are spelled ri..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning