Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Zippy Chimp

1. big a monkey I saw on a tv kill the zippy chimp..

Glory Dump

1. A Glory Dump MUST contain all of the following: 1. A large massive terd 2. Basically just fall out of your ass as soon as you sit down..

Fotl

1. Fruit of the Loom, a white man's type of boxer shorts, bland color and waistband. White man: i need more boxers honey, get me FOTL..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning