Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Spanky Mc Poop Smudge

1. A term to insult somebody who is a loser or a moron Mark you are a Spanky Mc Poop Smudge See loser, moron, idiot, virgin, fag..

Japanadan

1. an opinionated little wanker bash liberals, look at me mummy! See Japanadan..

Zohfeld

1. 1st grader stuck in the body of someone who should be mature. usually very clingy, and slow mentally. "Is that a 1st grader!?"..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning