Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Orally

1. 1: With your mouth 2: A funnier way to say oh really 3: A good way to confuse people 1: Doctor: These pills are to be taken orally o..

Vomeer

1. Afrikaans (Local South African language) word meaning: To eject the contents of ones stomach through the mouth. 1. As jy nog 'n do..

Vineeta

1. The energy, the power that circulates around the center of life; a strong allurethat forces other organisms toward it the smell of flow..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning