Robots.txt

What is Robots.txt?


1.

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM


35

Random Words:

1. The act of zapping one's dumb ass, with electricity or another form of unstable, powerful energy. Guy 1: Yo bitch wassup? Guy 2: ..
1. a semi automatic pistol "hours and hours of fear runnin through my mind as i pick up my zig nine" "the zigs on the hip ..
1. To annoyingly touch someone's elbow when they really hate u and want u to fuck off. fuck off, i don't want to go to ur house...