Robots.txt

What is Robots.txt?

File that stops search engines from crawling a specified page or directory.

Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

See KFM

Jockey Box

1. meaning: glove box ( DJ box --> because you store your CDs in the glove box) The CDs are in the jockey box. See dj, deejay..

Queen's Dutchery

1. Upon completion of lovemaking, you pull out and give the girl a pearl necklace while shitting on her head. Alias, Jason Chaffin. Suzie..

Adhire

1. (v) To acquiesce to. To comply with. North-Western American slang. Originates from gross mispronunciation of the word "adhere&qu..

All you need for a faster workflow in one place.

Robots.txt Edit Meaning