Robots.txt

What is Robots.txt?


1.

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM


35

Random Words:

1. people use the word jam jam as a shorter way to say jamica it can be used we askin wer sum 1 is from. oi blud .. wer u from jam jam in..
1. to animate something by means of the chinese zen wow i got totally zenimated by that guys scrabble abilites See zen, animate, zenify, ..
1. 2 people/opposing sides can "declare" a Lithuanian Fight. That means that each person gets as many of his friends as he/she ca..