Robots.txt

What is Robots.txt?


1.

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM


35

Random Words:

1. w4m= "Woman/Women for Men/Man" section of Personal ads. I'll let someone else bother to post defs for m4w, m4m, w4w, and ..
1. World's largest Bra Size at 73 ZZZ, belong to Norma Stitz 1999 Guiness Book of Records Title for THE LARGEST BREASTS IN THE WORL..
1. 1. White Girl Syndrome 2. Acting Like A white girl like if your man is cheating on you and you ask your self "what did i do wrong..