Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Jevas

1. how a squirrel says ice cream, also spelled lluevah/s try it! baghtjjjg ugrkgsrgo kgaerhmll lluevah/s(jevas)! "this is very good..

Zabranth

1. A sexy cuddle bug that likes men or women and occasionally is on top. Enjoys being taken advantage of more then anything. Zabranth, I w..

2x4

1. A piece of wood sizable enough to strike somebody down. Normally presented in inches while bill was asleep in his chair I beat him down..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning