Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Lmaowacimg

1. AOL slang for Laughing My Ass Off With A Cheeto In My Grasp Peter: And that's what she said. Frank: lmaowacimg..

Super Kids

1. Otherwise normal Childrenthat are born with adult sized genitaliawhich continue to grow with the child into Super Genitalia. Ron Jeremy..

Absativelyposolutely

1. like absatively but way more positive, the ultimate fantabulous height of positiveness Steve: are you sure you wanna do that man? Kyle..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning